-- Logs begin at Mon 2021-05-10 16:30:31 UTC, end at Mon 2021-05-10 17:47:01 UTC. -- May 10 17:11:27.265905 dv-cinder-786383-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 17:11:27.275546 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 10 17:11:27 2021] *** May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: nodename: dv-cinder-786383-3-iscsi May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: machine: x86_64 May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: clock source: unix May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: pcre jit disabled May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: detected number of CPU cores: 4 May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: current working directory: / May 10 17:11:27.277533 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: detected binary path: /usr/bin/uwsgi-core May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: your processes number limit is 47680 May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: your memory page size is 4096 bytes May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: detected max file descriptor number: 2048 May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: lock engine: pthread robust mutexes May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: thunder lock: enabled May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 17:11:27.278195 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 10 17:11:27.318742 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: Python main interpreter initialized at 0x5654db31e9c0 May 10 17:11:27.318742 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: python threads support enabled May 10 17:11:27.318742 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: your server socket listen backlog is limited to 100 connections May 10 17:11:27.318742 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: your mercy for graceful operations on workers is 90 seconds May 10 17:11:27.319072 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: mapped 403077 bytes (393 KB) for 2 cores May 10 17:11:27.319072 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: *** Operational MODE: preforking *** May 10 17:11:27.319343 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: *** uWSGI is running in multiple interpreter mode *** May 10 17:11:27.319343 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: spawned uWSGI master process (pid: 78016) May 10 17:11:27.319540 dv-cinder-786383-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 17:11:27.320111 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: spawned uWSGI worker 1 (pid: 78017, cores: 1) May 10 17:11:27.320439 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: spawned uWSGI worker 2 (pid: 78018, cores: 1) May 10 17:11:27.320591 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 17:11:28.930389 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:11:28.930389 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: from cryptography.utils import int_from_bytes May 10 17:11:28.931064 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:11:28.931064 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: from cryptography.utils import int_from_bytes May 10 17:11:28.944104 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:11:28.944104 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: from cryptography.utils import int_from_bytes May 10 17:11:28.944635 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:11:28.944635 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: from cryptography.utils import int_from_bytes May 10 17:11:31.479595 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:11:31.480133 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:11:31.480318 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:11:31.480704 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:11:31.480962 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:11:31.481346 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.481670 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.481990 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.482308 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.482663 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.482974 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.483292 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.483614 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.484042 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.484326 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.484645 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.484966 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786383-3-iscsi {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.485290 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.485596 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.485901 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.486217 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.486550 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.486872 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.487175 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.487673 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.488100 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.488408 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.488716 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.489051 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.489410 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.489666 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.489984 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.490287 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.490630 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.490938 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.491259 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786383-3-iscsi {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.491572 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.491892 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.492192 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.492607 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.492918 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.493250 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.493572 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.493894 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.494212 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.494574 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.494893 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.495210 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.495531 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.495840 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.496134 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.496963 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.497279 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.497582 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.497885 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.498134 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.498462 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.498785 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.499106 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.499427 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.499677 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.499926 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.500244 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.500562 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.500871 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.501179 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.501488 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.501794 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.502107 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.502432 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.502748 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.503055 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.503374 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.503691 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.504013 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.504400 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.504726 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.505126 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.505378 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.505686 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.506022 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.506353 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.506671 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.506997 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.507319 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.507628 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.507933 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.508239 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.508558 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.508880 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.509186 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.509435 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.509735 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.510039 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.510375 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.510686 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.510792 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:11:31.511201 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.511278 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:11:31.511346 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.511475 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:11:31.511636 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.512421 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:11:31.512517 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.512693 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:11:31.512780 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513035 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513127 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513342 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513427 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513649 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513733 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.513956 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514049 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514264 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514377 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514602 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514689 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514908 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.514995 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515226 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515310 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515544 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515630 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515852 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.515938 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516159 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516245 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516465 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516550 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786383-3-iscsi {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516778 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.516865 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517093 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517190 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517395 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517525 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517701 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.517794 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518008 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518091 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518311 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518420 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518636 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518731 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.518955 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519156 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519255 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519470 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519557 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519780 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.519865 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520092 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520178 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520430 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520517 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520745 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.520828 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521053 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521138 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521374 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521499 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521660 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521744 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.521964 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522058 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522266 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522384 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522596 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522721 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786383-3-iscsi {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.522900 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523061 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523203 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523375 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523502 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523691 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.523817 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524108 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524193 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524424 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524570 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524737 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.524830 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.525107 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.525218 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.525427 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.525762 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.525854 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.526097 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.526330 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.526490 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.526824 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.527092 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.527236 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.527426 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.527512 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.527784 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.527876 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.528109 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.528200 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.528418 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.528502 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.528735 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.528826 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.529042 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.529127 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.529354 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.529445 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.529663 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.529746 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.529972 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.530058 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.530228 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.530312 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.530567 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.530708 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.530897 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.530984 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.531227 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.531319 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.531548 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.531649 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.531854 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.531941 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.532138 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.532223 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.532465 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.532560 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.532791 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.532878 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.533099 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.533189 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.533410 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.533495 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.533723 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.533815 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.534035 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.534120 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.534383 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.534490 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.534684 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.534777 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.534997 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.535082 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.535307 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.535392 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.535619 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.535711 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.535932 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.536025 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.536248 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.536334 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.536560 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.536643 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.536869 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.536965 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.537202 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.537333 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.537517 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.537606 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.537826 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.537986 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.538130 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.538215 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.538464 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.538557 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.538769 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.538868 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.539078 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.539165 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.539381 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.539468 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.539700 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.539796 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.540025 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.540111 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.540333 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.540417 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.540657 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.540750 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.540961 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.541046 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.541272 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.541357 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.541524 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.541609 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.541829 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.541917 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.542140 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.542270 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.542488 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.542577 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.542796 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.542886 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.543627 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.543719 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.543942 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.544031 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.544248 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.544332 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.544555 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.544638 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.544868 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.544954 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.545249 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.545333 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.545565 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.545876 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.546325 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.546459 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.546541 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.546744 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.546895 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.547131 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.547411 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.547542 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.547731 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.547827 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.548068 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.548154 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.548398 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.548490 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.548704 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.548787 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.549030 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.549125 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.549345 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.549429 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.549659 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.549744 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.549963 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.550054 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.550275 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.550390 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.550621 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.550713 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.550928 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.551026 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.551234 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.551321 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.551543 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.551630 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.551849 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.551942 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.552154 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.552240 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.552457 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.552542 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.552762 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.552855 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.553065 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.553151 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.553369 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.553453 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.553678 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.553775 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.553983 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.554068 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.554286 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.554399 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.554612 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.554716 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.554917 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.555007 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.555225 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.555316 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.555531 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.555619 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.555840 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.555930 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.556146 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.556231 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.556457 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.556550 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.556758 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.556844 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.557070 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.557161 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.557377 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.557464 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.557688 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.557772 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.558001 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.558087 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.558305 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.558419 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.558642 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.558735 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:11:31.559497 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.559587 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.559808 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.559895 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560129 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560216 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560458 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560556 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560768 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.560862 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561080 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561168 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561400 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561564 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561711 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.561796 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562021 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562107 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562330 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562450 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562661 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562777 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.562965 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563100 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563275 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563489 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563581 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563817 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.563902 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564143 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564236 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564469 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564552 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564789 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.564879 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.565111 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.565208 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.565455 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.565674 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.565759 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.566052 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.566223 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.566394 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.566706 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.566798 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567031 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567351 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567478 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567655 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567820 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.567959 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568145 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568279 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568499 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568586 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568851 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.568936 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569165 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569247 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569466 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569553 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569803 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.569888 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570109 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570191 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570436 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570525 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570754 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.570838 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571075 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571159 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571385 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571471 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571699 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.571792 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572007 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572101 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572315 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572413 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572636 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572732 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.572947 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573040 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573253 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573339 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573561 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573644 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573871 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.573964 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574178 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574269 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574531 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574620 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574855 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.574953 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575161 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575246 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575468 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575561 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575777 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.575871 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576080 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576165 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576388 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576472 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576705 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.576791 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577014 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577281 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577367 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577615 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577709 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.577928 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578014 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578244 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578328 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578585 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578682 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578898 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.578983 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579225 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579317 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579535 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579629 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579845 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.579931 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580148 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580237 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580455 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580543 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580760 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.580845 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581067 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581160 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581377 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581463 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581679 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581764 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.581983 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582070 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582286 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582441 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582617 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582803 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.582924 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583117 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583214 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583451 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583536 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583784 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.583868 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584109 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584207 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584421 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584506 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584786 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.584906 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.585093 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.585415 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.585505 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.585725 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586018 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586102 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586322 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586646 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586729 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.586991 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587087 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587296 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587395 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587633 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587719 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.587961 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588053 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588288 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588381 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588591 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588674 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588896 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.588987 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589217 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589304 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589521 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589606 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589825 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.589911 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590158 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590245 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590494 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590584 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590798 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.590882 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591109 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591197 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591427 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591513 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591736 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.591830 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592039 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592134 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592347 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592436 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592650 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592735 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.592965 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593061 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593268 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593360 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593571 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593657 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593874 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.593969 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.594184 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.594269 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.594767 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.594856 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595071 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595169 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595391 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595476 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595701 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.595787 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596003 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596090 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596310 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596395 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596612 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596697 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.596917 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597004 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597222 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597307 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597543 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597629 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597856 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.597943 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598157 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598242 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598492 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598582 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598798 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.598892 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599100 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599186 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599403 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599565 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599708 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.599795 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600009 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600095 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600309 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600404 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600608 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600694 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.600910 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601002 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601212 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601305 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601531 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601616 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601837 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.601922 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602140 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602259 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602463 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602613 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602768 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.602925 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603109 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603236 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603411 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603563 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603850 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.603964 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.604159 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.604359 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.604473 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.604790 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.604903 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.605103 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.605415 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.605506 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.606241 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.606468 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.606559 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.606874 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607155 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607244 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607476 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607561 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607783 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.607865 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608084 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608171 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608406 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608490 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608716 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.608802 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609027 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609119 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609347 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609433 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609668 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609762 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.609986 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610070 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610287 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610384 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610618 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610715 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.610929 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611015 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611236 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611322 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611545 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611639 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611851 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.611936 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612164 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612255 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612476 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612574 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612786 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.612878 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613096 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613226 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613408 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613503 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613715 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.613801 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614024 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614312 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614440 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614646 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614732 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.614969 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615056 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615278 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615372 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615583 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615669 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615892 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.615978 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616196 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616290 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616507 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616592 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616811 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.616895 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617161 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617261 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617475 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617560 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617790 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.617875 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618098 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618184 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618435 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618524 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618747 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.618841 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619056 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619143 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619364 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619451 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619667 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619751 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.619973 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620087 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620279 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620401 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620585 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620714 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.620894 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.621025 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.621271 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.621846 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622090 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622176 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622433 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622548 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622747 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.622873 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623074 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623172 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623389 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623474 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623699 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.623783 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624010 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624157 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624320 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624464 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624786 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.624885 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.625205 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.625404 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.625514 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.625818 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.626003 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.626233 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.626469 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.626804 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.626893 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627127 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627212 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627442 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627534 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627764 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.627848 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628089 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628172 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628390 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628482 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628705 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.628790 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629015 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629108 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629324 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629416 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629644 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629729 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.629952 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630042 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630269 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630379 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630602 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630699 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.630922 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631006 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631232 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631317 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631545 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631630 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631890 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.631982 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.632207 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.632361 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.632517 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.632691 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.632833 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633005 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633136 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633330 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633443 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633657 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633773 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.633964 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634088 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634269 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634420 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634607 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634739 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.634916 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635050 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635223 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635359 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635546 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635673 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.635853 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636001 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636167 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636320 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636476 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636628 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636784 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.636969 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637118 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637280 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637424 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637589 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637747 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.637904 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638047 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638215 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638387 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638557 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638703 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.638841 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639024 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639147 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639346 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639455 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639650 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639749 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.639972 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640065 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640283 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640369 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640589 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640683 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640893 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.640980 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641198 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641290 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641542 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641636 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641847 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.641932 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642167 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642289 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642539 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642663 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642867 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.642984 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643187 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643366 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643546 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643699 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643834 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.643929 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644151 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644237 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644467 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644553 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644790 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.644874 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645093 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645177 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645397 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645482 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645706 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.645798 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646011 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646108 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646313 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646483 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646638 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646724 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.646951 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647045 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647254 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647339 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647590 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647682 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.647918 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648081 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648230 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648322 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648541 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648786 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.648872 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.649161 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.649375 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.649460 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.649759 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.649938 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.650063 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.650430 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.650553 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.650738 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.651072 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.651155 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.651394 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.651673 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.651767 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652028 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652247 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652340 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652670 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652850 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.652987 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.653306 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.653428 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.653622 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.653934 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.654028 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.654246 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.654592 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.654689 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.654909 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.655196 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.655283 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.655522 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.655822 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.655908 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.656139 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.656445 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.656676 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657011 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657101 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657325 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657614 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657701 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.657936 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.658254 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.658383 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.658592 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.658742 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.658902 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659039 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659211 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659376 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659519 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659700 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.659827 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660152 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660244 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660476 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660570 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660799 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.660883 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661138 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661222 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661456 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661551 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661772 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.661865 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662085 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662170 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662430 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662536 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662787 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.662872 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663104 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663224 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663414 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663557 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663733 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.663880 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664053 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664203 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664372 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664518 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664689 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.664831 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665004 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665153 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665318 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665486 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665664 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665802 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.665939 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666115 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666248 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666453 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666588 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666787 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.666907 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667101 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667234 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667431 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667570 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667859 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.667946 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.668720 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.668816 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669032 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669119 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669347 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669457 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669774 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.669865 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670094 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670182 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670449 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670538 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670781 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.670866 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671113 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671201 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671424 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671510 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671740 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.671831 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672055 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672140 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672358 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672441 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672663 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672757 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.672971 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673056 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673279 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673364 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673581 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673676 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673904 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.673990 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674212 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674297 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674541 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674641 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674862 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.674947 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.675171 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.675310 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.675644 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.675735 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.675962 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676048 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676289 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676374 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676622 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676709 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.676933 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677019 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677268 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677386 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677576 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677670 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677899 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.677984 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678206 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678291 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678535 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678623 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678848 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.678979 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.679214 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.679310 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.679535 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.679624 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.679838 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.680070 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.680155 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.680446 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.680598 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.680749 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.681058 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.681167 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.681407 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.681737 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.681904 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682045 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682237 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682384 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682605 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682704 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.682935 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.683022 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.683264 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.683391 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.683567 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.683704 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.684423 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.684513 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.684735 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.684827 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685068 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685164 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685374 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685472 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685691 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685776 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.685995 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686081 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686307 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686459 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686640 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686733 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.686949 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687070 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687259 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687412 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687583 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687749 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.687887 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688070 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688193 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688412 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688503 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688749 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.688849 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689072 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689159 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689396 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689482 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689712 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.689804 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690025 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690118 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690432 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690524 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690678 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.690940 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691026 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691277 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691365 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691587 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691683 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691904 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.691995 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.692212 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.692460 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.692553 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.692775 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.692874 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693097 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693189 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693387 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693471 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693712 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.693793 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694023 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694099 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694332 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694455 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694664 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694739 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.694989 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695079 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695284 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695383 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695594 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695688 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.695903 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696001 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696229 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696328 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696520 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696606 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696851 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.696936 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697196 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697287 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697526 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697612 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697848 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.697933 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698164 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698261 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698508 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698621 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698837 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.698961 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699161 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699287 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699498 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699619 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699821 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.699911 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700135 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700223 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700461 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700542 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700779 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.700854 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701083 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701172 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701510 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701643 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701824 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.701985 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.702240 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.702331 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.702577 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.702835 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.702924 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.703208 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.703385 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.703562 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.703899 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.703987 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.704217 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.704313 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.704546 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.704854 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705159 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705245 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705468 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705556 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705805 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.705896 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706136 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706230 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706486 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706579 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706811 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.706909 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707147 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707234 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707462 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707550 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707776 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.707876 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708088 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708174 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708400 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708486 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708712 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.708799 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709035 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709142 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709351 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709444 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709669 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709761 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.709980 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710082 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710301 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710424 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710635 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710734 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.710958 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711054 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711264 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711351 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711578 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711665 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.711885 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712019 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712200 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712286 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712532 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712619 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712847 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.712934 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713164 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713249 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713473 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713557 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713797 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.713883 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714105 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714192 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714449 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714540 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714773 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.714909 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715116 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715202 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715428 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715641 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715758 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.715963 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716068 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716303 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716389 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716635 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716730 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.716964 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717057 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717278 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717363 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717588 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717683 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.717916 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718001 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718229 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718325 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718559 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718647 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718875 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.718959 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.719191 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.719284 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.719779 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.719869 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720096 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720181 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720407 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720502 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720735 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.720820 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721044 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721127 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721360 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721454 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721671 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.721899 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.722070 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.722284 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.722405 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.722716 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.722903 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.723043 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.723368 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.723478 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.723693 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.723985 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.724080 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.724353 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.724679 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.724772 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725009 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725095 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725333 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725417 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725576 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:11:31.725662 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.725962 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.726289 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.726639 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.726956 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.727274 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.727597 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.727916 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.728227 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.728546 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.728860 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.729195 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.729514 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.729872 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.730138 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.730488 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.731323 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.731636 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.731948 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.732260 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.732582 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.732894 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.733211 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.733523 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.733841 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.734154 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.734491 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.734805 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.735136 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.735448 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.735759 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.736082 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.736397 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.736725 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.737047 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.737366 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.737716 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.738038 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.738641 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.738984 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.739317 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.739685 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.740294 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.740621 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.740938 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.741256 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.741589 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.741911 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.742400 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.742961 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.743830 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.744151 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.744859 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.745206 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.745521 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.745851 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.746179 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.747115 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.747454 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.747787 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.748116 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.748461 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.748772 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.749141 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.749506 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.749834 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.750164 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.750532 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.750857 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.751172 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.751611 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.751932 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.752260 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.752591 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.752912 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.753251 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.753616 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.753951 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.754286 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.754629 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.754945 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.755259 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.755581 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.755932 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.756275 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.756600 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.756929 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.757269 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.757590 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.757909 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.758229 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.758572 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.758894 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.759001 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_db.sqlalchemy.engines [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:31.759223 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.759551 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.759884 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.760204 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.760621 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.761022 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.761365 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.761682 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.762036 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.762378 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.762703 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.763221 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.763780 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.764362 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.764833 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.765271 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.765606 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.765947 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.766285 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.766649 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.766973 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.767315 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.767636 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.767958 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.768279 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.768597 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.768915 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.769235 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.769570 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.769911 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.770226 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.770587 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.770917 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.771246 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.771567 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.771888 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.772225 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.772547 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.772870 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.773189 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.773509 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.773834 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.774158 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.774518 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.774853 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.775186 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.775519 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.775876 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.776197 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.776547 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.776882 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:11:31.777133 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=78018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:11:31.812682 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_db.sqlalchemy.engines [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.003842 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.context [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6740535e-d17c-4eb6-84e0-32c35a6a2437(cell1) {{(pid=78017) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:11:32.008032 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_concurrency.lockutils [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:11:32.009704 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_concurrency.lockutils [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:11:32.010526 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_concurrency.lockutils [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:11:32.012634 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_concurrency.lockutils [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:11:32.040554 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_db.sqlalchemy.engines [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.042313 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_db.sqlalchemy.engines [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.072054 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG oslo_db.sqlalchemy.engines [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.073905 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.context [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6740535e-d17c-4eb6-84e0-32c35a6a2437(cell1) {{(pid=78018) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:11:32.078395 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:11:32.080077 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:11:32.080884 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:11:32.082895 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:11:32.114286 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_db.sqlalchemy.engines [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.115426 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_db.sqlalchemy.engines [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.146503 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_db.sqlalchemy.engines [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:11:32.514981 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: WARNING keystonemiddleware.auth_token [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:11:32.522594 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: WARNING keystonemiddleware.auth_token [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:11:32.559771 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: WARNING keystonemiddleware.auth_token [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:11:32.566314 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: WARNING keystonemiddleware.auth_token [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:11:32.747581 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: WARNING keystonemiddleware.auth_token [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:11:32.752835 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: WARNING keystonemiddleware.auth_token [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:11:32.758176 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654db31e9c0 pid: 78017 (default app) May 10 17:11:32.760317 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:11:32.761439 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 May 10 17:11:32.762467 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 789 bytes} [Mon May 10 17:11:32 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:11:32.781083 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: WARNING keystonemiddleware.auth_token [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:11:32.786214 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: WARNING keystonemiddleware.auth_token [None req-af160c95-1cfd-408c-97c1-dc3ab5f30a0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:11:32.791522 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5654db31e9c0 pid: 78018 (default app) May 10 17:12:52.892413 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:12:52.893405 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 10 17:12:52.894265 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:12:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:12:53.370827 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-a17c9bc5-1a5d-40b9-a3ba-12034d5d2212 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:12:53.512263 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-a17c9bc5-1a5d-40b9-a3ba-12034d5d2212 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.611029 May 10 17:12:53.513311 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 10 17:12:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:12:55.760695 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:12:55.761782 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-25ad6a29-111a-43d5-b446-13ce929761ba None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 10 17:12:55.762226 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:12:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:12:55.824514 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-abec231c-9efb-4ea8-adb5-bd155d041670 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "disk": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:12:55.846092 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:12:55.846092 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:12:55.875579 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-abec231c-9efb-4ea8-adb5-bd155d041670 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106153 May 10 17:12:55.876387 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:12:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:12:56.121406 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-b32d482d-cc93-4049-bea1-d6b8546813b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:12:56.124148 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:12:56.124148 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: warnings.warn(msg) May 10 17:12:56.294991 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-b32d482d-cc93-4049-bea1-d6b8546813b7 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.410615 May 10 17:12:56.297958 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 10 17:12:55 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:12:58.499312 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-abec231c-9efb-4ea8-adb5-bd155d041670 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:12:58.500464 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-abec231c-9efb-4ea8-adb5-bd155d041670 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 May 10 17:12:58.500996 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:12:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:12:58.610148 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-42853d06-54f3-4778-8f06-f6236e3cd992 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "disk": 5}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:12:58.628229 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:12:58.628229 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: warnings.warn(msg) May 10 17:12:58.655714 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-42853d06-54f3-4778-8f06-f6236e3cd992 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148940 May 10 17:12:58.656273 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:12:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:12:58.667909 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-f29a8b2b-4c22-4a10-950b-09e9b29ca7dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:12:58.669489 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:12:58.669489 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:12:58.706372 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-f29a8b2b-4c22-4a10-950b-09e9b29ca7dc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042135 May 10 17:12:58.706946 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 10 17:12:58 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:13:00.857014 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-42853d06-54f3-4778-8f06-f6236e3cd992 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:00.858034 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-42853d06-54f3-4778-8f06-f6236e3cd992 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 10 17:13:00.858636 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:00.925532 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-ccb6e6a1-1e94-462c-8cf5-ab6e537b30cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:00.951605 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-ccb6e6a1-1e94-462c-8cf5-ab6e537b30cf admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087143 May 10 17:13:00.959241 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:00.964995 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-9a910c4e-472d-4ff2-b796-a2cbe91f8106 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:01.015504 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-9a910c4e-472d-4ff2-b796-a2cbe91f8106 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054465 May 10 17:13:01.025331 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 10 17:13:00 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:03.165999 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-ccb6e6a1-1e94-462c-8cf5-ab6e537b30cf admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:03.167588 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-ccb6e6a1-1e94-462c-8cf5-ab6e537b30cf admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 10 17:13:03.168014 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:03.235212 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-a52c740a-7293-4350-b290-6243a257d612 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "swap": 0, "vcpus": 2, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:03.262797 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-a52c740a-7293-4350-b290-6243a257d612 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088593 May 10 17:13:03.263486 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:03.275188 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-b8d680cf-a1b4-4bb6-8797-6b9a0dfdc0b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:03.313169 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-b8d680cf-a1b4-4bb6-8797-6b9a0dfdc0b2 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041604 May 10 17:13:03.313779 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 10 17:13:03 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:13:05.471079 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-a52c740a-7293-4350-b290-6243a257d612 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:05.472691 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-a52c740a-7293-4350-b290-6243a257d612 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002330 May 10 17:13:05.473097 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:05.545953 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:05.578203 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098978 May 10 17:13:05.579173 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:13:05.591580 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-4d11ea2d-7e7a-416b-b857-b1eaaf47ba69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:05.632946 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-4d11ea2d-7e7a-416b-b857-b1eaaf47ba69 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045542 May 10 17:13:05.634495 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1335 bytes} [Mon May 10 17:13:05 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:07.801120 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:07.802136 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 10 17:13:07.802799 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:07.864272 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-15b0bbf8-58db-4fc8-aa83-7ff509e3885a admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:07.890332 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-15b0bbf8-58db-4fc8-aa83-7ff509e3885a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080667 May 10 17:13:07.897714 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 10 17:13:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:13:10.078627 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:10.079943 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-af25c688-8c17-4f09-91d9-e8e23431eafd admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001917 May 10 17:13:10.080491 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:13:10.149438 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-0f9921b7-c8c6-4ce9-abf8-c2cfc21912e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:10.176952 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-0f9921b7-c8c6-4ce9-abf8-c2cfc21912e3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.088994 May 10 17:13:10.177524 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:10 2021] POST /compute/v2.1/flavors => generated 402 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:10.191329 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-1be933d9-1e59-4a30-8f03-b8bd50baa263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:10.238873 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-1be933d9-1e59-4a30-8f03-b8bd50baa263 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052095 May 10 17:13:10.239634 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 10 17:13:10 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:12.362752 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-0f9921b7-c8c6-4ce9-abf8-c2cfc21912e3 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:12.363799 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-0f9921b7-c8c6-4ce9-abf8-c2cfc21912e3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 May 10 17:13:12.364416 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:12.423014 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-78c39769-1fc9-49f2-868e-f0bffc24b8b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:12.449183 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-78c39769-1fc9-49f2-868e-f0bffc24b8b2 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078125 May 10 17:13:12.449759 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:12.461814 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-007a956b-ae32-4fa0-a04f-91375ef47992 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:12.503200 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-007a956b-ae32-4fa0-a04f-91375ef47992 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044956 May 10 17:13:12.504152 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 10 17:13:12 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:14.744051 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-78c39769-1fc9-49f2-868e-f0bffc24b8b2 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:14.745578 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-78c39769-1fc9-49f2-868e-f0bffc24b8b2 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 17:13:14.745983 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:14.803142 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-95b27e3d-d472-439b-aa65-586ea8b150b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:14.828734 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-95b27e3d-d472-439b-aa65-586ea8b150b3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.076776 May 10 17:13:14.829366 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:14 2021] POST /compute/v2.1/flavors => generated 406 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:14.840847 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-e66f8385-32fe-424c-906b-b8031ab62c6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:14.880682 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-e66f8385-32fe-424c-906b-b8031ab62c6e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043532 May 10 17:13:14.881295 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 10 17:13:14 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:17.006565 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-95b27e3d-d472-439b-aa65-586ea8b150b3 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:17.007642 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-95b27e3d-d472-439b-aa65-586ea8b150b3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 May 10 17:13:17.008003 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:17.070700 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-12a3e8f7-f81b-4a0a-aa0a-399e98efe6c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "vcpus": 4, "ram": 8192}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:17.095578 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-12a3e8f7-f81b-4a0a-aa0a-399e98efe6c2 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080673 May 10 17:13:17.096068 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:17 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:13:17.108202 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-7f555f0c-e558-4602-9f03-3107353b0e6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:17.143547 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-7f555f0c-e558-4602-9f03-3107353b0e6c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039546 May 10 17:13:17.144152 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 10 17:13:17 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:13:19.315493 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-12a3e8f7-f81b-4a0a-aa0a-399e98efe6c2 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:19.316417 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-12a3e8f7-f81b-4a0a-aa0a-399e98efe6c2 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 17:13:19.316832 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:19.380984 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:19.405690 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082733 May 10 17:13:19.406247 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1282 bytes} [Mon May 10 17:13:19 2021] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:13:19.418161 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-56be6560-d6e2-4119-91ae-7154e8170a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:13:19.457888 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-56be6560-d6e2-4119-91ae-7154e8170a27 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043608 May 10 17:13:19.459064 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1332 bytes} [Mon May 10 17:13:19 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:13:58.458195 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:58.459256 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 10 17:13:58.459660 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 930 bytes} [Mon May 10 17:13:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:13:58.516085 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-50ae09f1-89e5-43d3-86ea-1d1386c7590c admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:58.538958 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-50ae09f1-89e5-43d3-86ea-1d1386c7590c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073539 May 10 17:13:58.539513 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1291 bytes} [Mon May 10 17:13:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:13:59.912538 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:13:59.913608 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-7ff314a7-6d77-4614-8d81-f3d014720e07 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 10 17:13:59.914013 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:13:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:00.099526 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-5d4282cd-ae46-4447-bfbe-c15eecd2cc80 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:00.112269 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.wsgi [None req-5d4282cd-ae46-4447-bfbe-c15eecd2cc80 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 17:14:00.112846 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-5d4282cd-ae46-4447-bfbe-c15eecd2cc80 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:00.113640 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-5d4282cd-ae46-4447-bfbe-c15eecd2cc80 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064618 May 10 17:14:00.114169 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1191 bytes} [Mon May 10 17:14:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:14:00.124207 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-3f8f79cb-4923-4181-8cf7-bde614d6b3f3 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:00.143707 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-3f8f79cb-4923-4181-8cf7-bde614d6b3f3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023057 May 10 17:14:00.144260 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:14:00.153803 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-ef7ece85-e3c0-4165-9d2a-5ddc9cba1229 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:00.174142 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-ef7ece85-e3c0-4165-9d2a-5ddc9cba1229 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023825 May 10 17:14:00.174716 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:14:00.184713 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-d7c9f095-e22b-427e-8b07-b12dcc7c3c21 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:00.197001 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.wsgi [None req-d7c9f095-e22b-427e-8b07-b12dcc7c3c21 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 17:14:00.197583 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-d7c9f095-e22b-427e-8b07-b12dcc7c3c21 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=78017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:00.198412 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-d7c9f095-e22b-427e-8b07-b12dcc7c3c21 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017887 May 10 17:14:00.198935 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1191 bytes} [Mon May 10 17:14:00 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:14:01.496215 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-ef7ece85-e3c0-4165-9d2a-5ddc9cba1229 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:01.497247 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-ef7ece85-e3c0-4165-9d2a-5ddc9cba1229 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 10 17:14:01.497650 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:01.684638 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-c5c53559-6501-4c5a-a36a-06b711dbdd1c admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:01.696725 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.wsgi [None req-c5c53559-6501-4c5a-a36a-06b711dbdd1c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 17:14:01.697298 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-c5c53559-6501-4c5a-a36a-06b711dbdd1c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:01.698090 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-c5c53559-6501-4c5a-a36a-06b711dbdd1c admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.064161 May 10 17:14:01.698653 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1191 bytes} [Mon May 10 17:14:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:14:01.708266 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-65c2adad-80b0-4252-82d4-36635b036407 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:01.728871 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-65c2adad-80b0-4252-82d4-36635b036407 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023718 May 10 17:14:01.729449 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:14:01.738972 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-8a9b6a35-9397-45c5-9930-f85afcdabdfe admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:01.759403 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-8a9b6a35-9397-45c5-9930-f85afcdabdfe admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023914 May 10 17:14:01.759959 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:01 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:14:01.769653 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-130115f3-4428-4d49-b965-145a57b91dd2 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:01.782068 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.wsgi [None req-130115f3-4428-4d49-b965-145a57b91dd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 17:14:01.782664 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-130115f3-4428-4d49-b965-145a57b91dd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=78018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:01.783452 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-130115f3-4428-4d49-b965-145a57b91dd2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017460 May 10 17:14:01.784009 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1191 bytes} [Mon May 10 17:14:01 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 17:14:03.089999 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-8a9b6a35-9397-45c5-9930-f85afcdabdfe admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:03.091160 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-8a9b6a35-9397-45c5-9930-f85afcdabdfe admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 10 17:14:03.091524 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:03.276743 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-e8be8198-b440-4c62-b7cd-93c355957523 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:03.288857 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.wsgi [None req-e8be8198-b440-4c62-b7cd-93c355957523 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 17:14:03.289428 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-e8be8198-b440-4c62-b7cd-93c355957523 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78018) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:03.290237 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-e8be8198-b440-4c62-b7cd-93c355957523 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063659 May 10 17:14:03.291291 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:14:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:14:03.300639 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-13a2293d-01c1-4460-8821-a5b2733d5799 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:03.321666 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-13a2293d-01c1-4460-8821-a5b2733d5799 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024591 May 10 17:14:03.322217 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:14:03.332829 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:03.354797 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026195 May 10 17:14:03.355380 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1211 bytes} [Mon May 10 17:14:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:14:03.365536 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-a4a5135b-ba94-4881-88cb-b85369cfac4f admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:03.378096 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.wsgi [None req-a4a5135b-ba94-4881-88cb-b85369cfac4f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 17:14:03.378694 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-a4a5135b-ba94-4881-88cb-b85369cfac4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=78017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:14:03.379482 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-a4a5135b-ba94-4881-88cb-b85369cfac4f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017609 May 10 17:14:03.380115 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:14:03 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:14:04.695935 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:04.697432 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 10 17:14:04.697841 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:04.885598 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-115556ce-d43a-480d-8905-484e4999cdc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:14:04.911475 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-115556ce-d43a-480d-8905-484e4999cdc6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.076772 May 10 17:14:04.912023 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1236 bytes} [Mon May 10 17:14:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:14:06.239285 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:06.240278 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 10 17:14:06.240705 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:06.428501 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-64fe9861-f1d0-4cdd-93a4-2e7d712d4fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:14:06.452299 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-64fe9861-f1d0-4cdd-93a4-2e7d712d4fc9 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.074341 May 10 17:14:06.452846 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1236 bytes} [Mon May 10 17:14:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:14:07.762224 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:07.763350 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 10 17:14:07.763792 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:07.953863 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-dd922691-55dd-4456-a82c-b60d2bfe4b90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:14:07.978966 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-dd922691-55dd-4456-a82c-b60d2bfe4b90 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.076576 May 10 17:14:07.979460 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1236 bytes} [Mon May 10 17:14:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:14:09.302682 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:09.303679 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 10 17:14:09.304080 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:09.493263 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-7dd900a2-a642-4c6e-bdbb-7b3b49bca61a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:14:09.516749 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-7dd900a2-a642-4c6e-bdbb-7b3b49bca61a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.075124 May 10 17:14:09.517304 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1236 bytes} [Mon May 10 17:14:09 2021] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:14:10.865992 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:10.867024 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 10 17:14:10.867436 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:11.054656 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-598827ab-e233-4cda-9cdb-561ce9077466 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:11.079796 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-598827ab-e233-4cda-9cdb-561ce9077466 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.077048 May 10 17:14:11.080346 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1203 bytes} [Mon May 10 17:14:11 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:14:55.270243 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:55.271287 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-3c974ede-c942-4a91-be06-af6696e4e551 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 10 17:14:55.271749 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 31/63] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:14:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:14:55.465934 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:14:55.491077 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075112 May 10 17:14:55.491623 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1203 bytes} [Mon May 10 17:14:55 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:16:11.012643 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-87dea733-933d-4717-afd1-b9d4f4af2cd3 tempest-verify_tempest_config-474544878 tempest-verify_tempest_config-474544878-project] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:16:11.014722 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-87dea733-933d-4717-afd1-b9d4f4af2cd3 tempest-verify_tempest_config-474544878 tempest-verify_tempest_config-474544878-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121191 May 10 17:16:11.015270 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 32/65] 10.222.0.32 () {58 vars in 1134 bytes} [Mon May 10 17:16:10 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:17:42.401564 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:42.402621 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 May 10 17:17:42.403030 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 34/66] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:17:42 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:17:42.663175 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:42.664336 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:17:42.664336 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:17:42.665929 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:42.666392 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:42.667193 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:42.667621 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:42.700050 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-c0e2fe64-fe97-4555-a7d7-4d3b9fe64b8f admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.156289 May 10 17:17:42.700620 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:17:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:17:44.023079 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:44.024084 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 17:17:44.024482 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 35/68] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:17:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:17:44.209147 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:44.210302 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:17:44.210302 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:17:44.211922 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:44.212361 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:44.213812 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:44.214238 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:44.236999 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-c108a6fa-416e-4f49-8762-fffa66b8a43b admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.076392 May 10 17:17:44.237481 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 34/69] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:17:44 2021] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:17:55.980184 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:55.981199 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 10 17:17:55.981609 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:17:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:17:56.168361 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:56.169511 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:17:56.169511 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:17:56.171056 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:56.171502 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:56.172293 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:56.172723 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:56.201031 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-41ce7754-db52-49bd-ae70-8bf3c9a6d373 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.081953 May 10 17:17:56.201521 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:17:56 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:17:57.505832 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: DEBUG nova.api.openstack.wsgi [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] Calling method '>' {{(pid=78017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:57.506880 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: INFO nova.api.openstack.requestlog [None req-eba58806-bb98-4853-b0a9-8dc408a9d3b5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 10 17:17:57.507290 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: [pid: 78017|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1075 bytes} [Mon May 10 17:17:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:17:57.697928 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG nova.api.openstack.wsgi [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] Calling method '>' {{(pid=78018) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:17:57.699178 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:17:57.699178 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: warnings.warn(msg) May 10 17:17:57.700721 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:57.701164 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:57.701942 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:17:57.702388 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: DEBUG oslo_concurrency.lockutils [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=78018) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:17:57.728836 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: INFO nova.api.openstack.requestlog [None req-4b4e74ed-38ce-47ed-9f69-f00467333efb admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.080237 May 10 17:17:57.729323 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: [pid: 78018|app: 0|req: 36/73] 10.222.0.32 () {60 vars in 1194 bytes} [Mon May 10 17:17:57 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:18:56.669987 dv-cinder-786383-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 17:18:56.670641 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: Mon May 10 17:18:56 2021 - graceful shutdown triggered... May 10 17:18:56.671115 dv-cinder-786383-3-iscsi devstack@n-api.service[78017]: Gracefully killing worker 1 (pid: 78017)... May 10 17:18:56.671609 dv-cinder-786383-3-iscsi devstack@n-api.service[78018]: Gracefully killing worker 2 (pid: 78018)... May 10 17:18:57.671724 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: worker 1 buried after 1 seconds May 10 17:18:57.671724 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: worker 2 buried after 1 seconds May 10 17:18:57.671724 dv-cinder-786383-3-iscsi devstack@n-api.service[78016]: goodbye to uWSGI. May 10 17:18:57.673356 dv-cinder-786383-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 17:18:57.673903 dv-cinder-786383-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 17:18:57.676771 dv-cinder-786383-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 17:18:57.686538 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 17:18:57.689265 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 10 17:18:57 2021] *** May 10 17:18:57.689449 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 17:18:57.689594 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 17:18:57.689715 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: nodename: dv-cinder-786383-3-iscsi May 10 17:18:57.689830 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: machine: x86_64 May 10 17:18:57.689938 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: clock source: unix May 10 17:18:57.690056 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: pcre jit disabled May 10 17:18:57.690164 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: detected number of CPU cores: 4 May 10 17:18:57.690272 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: current working directory: / May 10 17:18:57.690408 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: detected binary path: /usr/bin/uwsgi-core May 10 17:18:57.690538 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: your processes number limit is 47680 May 10 17:18:57.690650 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: your memory page size is 4096 bytes May 10 17:18:57.690758 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: detected max file descriptor number: 2048 May 10 17:18:57.690880 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: lock engine: pthread robust mutexes May 10 17:18:57.691152 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: thunder lock: enabled May 10 17:18:57.691459 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 17:18:57.691711 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 10 17:18:57.733060 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: Python main interpreter initialized at 0x5616b8e859c0 May 10 17:18:57.733060 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: python threads support enabled May 10 17:18:57.733060 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: your server socket listen backlog is limited to 100 connections May 10 17:18:57.733060 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: your mercy for graceful operations on workers is 90 seconds May 10 17:18:57.733480 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: mapped 403077 bytes (393 KB) for 2 cores May 10 17:18:57.733559 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: *** Operational MODE: preforking *** May 10 17:18:57.733784 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: *** uWSGI is running in multiple interpreter mode *** May 10 17:18:57.733784 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: spawned uWSGI master process (pid: 92795) May 10 17:18:57.733985 dv-cinder-786383-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 17:18:57.734883 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: spawned uWSGI worker 1 (pid: 92809, cores: 1) May 10 17:18:57.735012 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: spawned uWSGI worker 2 (pid: 92810, cores: 1) May 10 17:18:57.737025 dv-cinder-786383-3-iscsi devstack@n-api.service[92795]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 17:18:59.502103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:18:59.502103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: from cryptography.utils import int_from_bytes May 10 17:18:59.502900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:18:59.502900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: from cryptography.utils import int_from_bytes May 10 17:18:59.511021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:18:59.511021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: from cryptography.utils import int_from_bytes May 10 17:18:59.511619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:18:59.511619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: from cryptography.utils import int_from_bytes May 10 17:19:01.895080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:19:01.895626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:19:01.895823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:19:01.896196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:19:01.896460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:19:01.896859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.897203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.897540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.897876 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.898220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.898571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.898911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.899240 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.899582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.899853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.900182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.900520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786383-3-iscsi {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.900857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.901182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.901500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.901834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.902153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.902516 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.902835 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.903344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.904466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.904466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.904466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.904775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.905097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.905420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.905755 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.906070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.906467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.906776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.907128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786383-3-iscsi {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.907443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.907770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.908098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.908527 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.908861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.909186 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.909521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.909862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.910183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.910548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.910885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.911238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.911560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.912774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.912774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.912774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.914964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.915447 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.915447 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.915775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.916110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.916442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.916759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.917079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.917399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.917720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.918041 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.918376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.918700 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.919040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.919368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.919703 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.921471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.921471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.921471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.921971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.922116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.922368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.922705 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.923026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.923360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.923699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.924023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.924341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.924662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.924996 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.925331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.925648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.925911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.926223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.926569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.927036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.927361 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.927684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.928006 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.928333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.928640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.928958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.929278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.929603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.929922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.930237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.930646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.930896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.931213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.931545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.931878 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.932200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.932519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.932836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.933156 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.933488 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.933807 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.934124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.934483 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.934804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.935123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.935456 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.935706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:19:01.936663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.936813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:19:01.937044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.937044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.937344 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:19:01.937495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.937634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:19:01.937830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.937976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:19:01.938124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.938289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.938465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.938633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.938851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.939933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.940882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.941036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.941188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.941188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942311 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942524 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-786383-3-iscsi {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942903 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.942977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.943059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.943130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.943207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.943312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.943405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.943717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.943818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.943998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.944105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.944350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.944611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.944738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.944898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.945045 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.945192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.945351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.945513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.945660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.945840 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.946014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.946163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.946325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.946523 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.946682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.946860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.946970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.947188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.947304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.947534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.947648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.947863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.947977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.948202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-786383-3-iscsi {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.948315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.948534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.948639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.948862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.948959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.949191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.949288 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.949545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.949647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.949890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.949995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.950226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.950328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.950595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.950751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.950932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.951090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.951301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.951451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.951639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.951810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.951964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.952134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.952277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.952426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.952621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.952801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.952954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.953103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.953255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.953407 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.953556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.953718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.953870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.954023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.954173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.954314 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.954730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.954894 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.955060 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.955211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.955359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.955512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.955661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.955810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.955962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.956104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.956250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.956395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.956540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.956682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.956845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.956997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.957144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.957303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.957458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.957615 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.957764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.957916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.958060 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.958206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.958374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.958534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.958696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.958839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.958979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.959127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.959348 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.959565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.959718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.959861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.960050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.960201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.960356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.960499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.960640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.960791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.960932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.961072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.961230 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.961372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.961519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.961668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.961817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.961964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.962120 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.962269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.962517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.962663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.962813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.962955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.963108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.963248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.963389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.963539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.963715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.963865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.964054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.964202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.964383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.964536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.965014 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.965175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.965326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.965470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.965610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.965757 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.965905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.966060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.966202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.966367 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.966516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.966669 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.966818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.966979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.967122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.967270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.967411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.967559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.967707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.967857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.968012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.968163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.968305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.968452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.968608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.968766 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.968928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.969125 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.969280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.969505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.969663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.969812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.969964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.970106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.970254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.970444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.970602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.970753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.970909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.971071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.971214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.971362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.971503 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.971652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.971795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.971936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.972076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.972216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.972357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.972510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.972660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.973071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.973224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.973366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.973507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.973657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.973807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.973948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.974101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.974250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.974409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.974556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.974741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.975206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.975373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.975537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.975696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.975839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.975986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.976128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.976282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.976430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.976577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.976718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.976858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.977013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.977155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.977296 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.977450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.977591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.977739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.977893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.978037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.978185 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.978369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.978522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.978664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.978828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.978979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.979132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.979281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.979443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.979679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.979847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.980000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.980144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.980293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.980436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.980585 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.980739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.980888 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.981031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.981181 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.981341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.981492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.981633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.981780 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.981922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.982062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.982285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.982453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:19:01.983176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.983327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.983523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.983677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.983859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.984875 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.985358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.985358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.985654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.985654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.985920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.986070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.986219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.986426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.986583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.986758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987384 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987818 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.987966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988115 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.988868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.989994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.990922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991219 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.991957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.992866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.993911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.994091 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.994252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.994610 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.994784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.994939 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.995296 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.995631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996429 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.996867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.997885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.998035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.998245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.998943 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:01.999852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.000973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.001862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.002934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003367 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.003977 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004259 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.004852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.005000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.005143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.005446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.005788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.005939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.006863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.007867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.008887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009630 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.009930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.010102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.010315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.010556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.010718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.010861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011160 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011451 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011748 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.011896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012344 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.012866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013205 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013512 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.013897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.014940 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.015089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.015276 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.015591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.015926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016838 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.016986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.017982 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.018891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019186 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019344 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.019918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020607 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.020896 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.021914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.022901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.023077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.023233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.023409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.023733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.023905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.024900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025341 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.025969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.026460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.026460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.026746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.026746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.027986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.028909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.029844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.030000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.030155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.030155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.030561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.030845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.031255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.031426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.031582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.031739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.031887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032242 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.032914 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.033164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.033318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.033509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.033683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.033833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034206 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.034890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.035976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.036139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.036470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.036634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.036794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.036950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.037868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038190 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.038879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.039963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.040112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.040270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.040417 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.040674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.040838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.041929 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.042079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.042237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.042531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.042713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.042875 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043026 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.043892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044712 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.044868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.045507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.045655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.045815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.046305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.046696 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.046868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047484 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047644 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.047957 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048104 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.048881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049193 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.049954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.050981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051136 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.051918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052651 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.052956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.053883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054185 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.054938 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055404 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.055912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.056218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.056410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.056565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.056905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.057998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.058991 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059440 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.059910 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.060060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.060229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.060386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.060542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.061360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.061518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.061518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.061801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.061949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.062978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.063877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.064033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.066798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.067180 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.067359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.067517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.067681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.067856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068160 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068457 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.068926 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.069968 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070120 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070271 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070777 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.070927 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071084 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.071979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.072903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073214 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073838 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.073995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.074956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.075883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.076055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.076241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.076416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.076574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.076574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.077033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.077445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.077616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.077767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.077915 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078219 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.078871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.079939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.080242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.080242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.080547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.080702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.080858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.081876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082705 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.082855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.083913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084367 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084523 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084837 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.084986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.085892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086185 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.086831 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.087970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.088252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.088407 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.088563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.088563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.088869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.089771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.090886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091667 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.091944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.092910 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093522 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093828 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.093977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.094920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.095987 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.096764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.097071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.097364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.097364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.098108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.098268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.098587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.098744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.098892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099672 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.099891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100355 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.100971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.101875 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102585 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.102902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103205 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103205 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.103973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.104891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.105994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.106149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.106310 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.106553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.106724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.106882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.107033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.107180 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.108950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.109108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.110095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.110095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.110095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.110567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.110748 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.111068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.111394 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.111715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.111963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.112058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.112344 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.112446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.112710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.112793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.113070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.113419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.113509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.113756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.113835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.114198 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.114288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.114614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.114717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.114928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.115010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.115275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.115355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.115617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.115706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116138 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116602 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.116922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.117071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.117224 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.117529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.117701 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.117862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.118029 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.118402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.118402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.118699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.118857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.119056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.119417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.119774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.120100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.120428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.120749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.121090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.121419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.121746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.122072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.127517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.127749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.127931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.127931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.128246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.128246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.128569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.128569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.128888 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129367 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129525 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129697 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.129861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130673 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.130987 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.131614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.132744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.133893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.133893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.133893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.133893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.134520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.134678 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.138371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.138371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.138789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.138980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.138980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.139286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.139451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.139604 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.139754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.139902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.140967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.141442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.142695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.142695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.142695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.142695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.143260 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.143260 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.143548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.143873 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.144216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.144501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.144683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.145111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.145438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.145770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.146101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.146478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.146817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.146933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.147143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.147497 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.147847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.148132 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.148236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.148503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.148841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.149178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.149447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.149550 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.149827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.150177 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.150537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.150788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.150889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.151189 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.151518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.151853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.152103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.152213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.152516 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.152860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.153245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.153360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.153649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.154018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.154893 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.155010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.155431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.155781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.156454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:19:02.157170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.157752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.158326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.158930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.159541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.160108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.160657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.161229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.161809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.162586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.163149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.163733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.164849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.165546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.166258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.167079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.167608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.168112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.168633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.169164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.169718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.170783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.171303 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.171800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.172684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.173200 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.173723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.174242 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.174791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.175298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.179631 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.180032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.180397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.180746 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.181101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.181454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.181796 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.182159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.182529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.182864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.183211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.183630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.184152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.184525 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.184869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.185220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.185602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.185945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.186278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.186673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.187005 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.187456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.187802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.188140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.188467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.188827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.189184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.189517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.189844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.190176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.190561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.190913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.191241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.191565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.191915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.192255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.192511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_db.sqlalchemy.engines [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.192621 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.192893 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.193215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.193568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.193899 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.194221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.194608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.194935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.195267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.195590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.195918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.196239 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.196825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.196933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.197209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.197546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.198106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.198480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.198813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.199149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.199522 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.199860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.200443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.200800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.201140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.201541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.201901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.202234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.202583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.202924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.203248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.203575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.203905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.204234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.204562 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.204891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.205219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.205547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.205874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.206203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.206688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.207064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.207407 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.207747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.208217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.208555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.208886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.209218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.209631 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.210189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.210561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.210987 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.211324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.211652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.212348 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.212538 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.212878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.213221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.213555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.213908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.214284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.214666 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.215015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.215376 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.215663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.215989 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.216321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.216686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.217567 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.217905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.218250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.218752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.219087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.219419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.219754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.220085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.220415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.220752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.221090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.221430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.221761 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.222112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.222466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.223068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.223393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.223727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.224055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.224387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.224741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.225073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.225414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.225747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.226093 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.226443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.226787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.227130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.227469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.227797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.228149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.228478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.228809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.229140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.229470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.229796 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.230122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.230498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.230848 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.231175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.231520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.231859 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.232199 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.233148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.233486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.233838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.234174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.234537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.234869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.235200 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.235537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.235874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.236220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.236566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.236911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.237254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.237618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.237951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.238313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.238684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:19:02.238942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:19:02.270532 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_db.sqlalchemy.engines [None req-36e97798-796d-43bc-a358-c13006773e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.533714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.context [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6740535e-d17c-4eb6-84e0-32c35a6a2437(cell1) {{(pid=92809) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:19:02.538281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:02.540055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:02.540940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:02.543116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:02.570923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_db.sqlalchemy.engines [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.571759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_db.sqlalchemy.engines [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.600632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_db.sqlalchemy.engines [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.606710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.context [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6740535e-d17c-4eb6-84e0-32c35a6a2437(cell1) {{(pid=92810) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:19:02.611591 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:02.613409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:02.614247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:02.616302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:02.642744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_db.sqlalchemy.engines [None req-36e97798-796d-43bc-a358-c13006773e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.645188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_db.sqlalchemy.engines [None req-36e97798-796d-43bc-a358-c13006773e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.673287 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_db.sqlalchemy.engines [None req-36e97798-796d-43bc-a358-c13006773e9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:19:02.913268 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: WARNING keystonemiddleware.auth_token [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:19:02.921327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: WARNING keystonemiddleware.auth_token [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:19:02.981017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: WARNING keystonemiddleware.auth_token [None req-36e97798-796d-43bc-a358-c13006773e9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:19:02.988437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: WARNING keystonemiddleware.auth_token [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:19:03.143990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: WARNING keystonemiddleware.auth_token [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:19:03.149576 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: WARNING keystonemiddleware.auth_token [None req-e23900a6-2dac-47e3-8580-d43894589f2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:19:03.155279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616b8e859c0 pid: 92809 (default app) May 10 17:19:03.205403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: WARNING keystonemiddleware.auth_token [None req-36e97798-796d-43bc-a358-c13006773e9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:19:03.210869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: WARNING keystonemiddleware.auth_token [None req-36e97798-796d-43bc-a358-c13006773e9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:19:03.216004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5616b8e859c0 pid: 92810 (default app) May 10 17:19:35.639797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2cbd1fd-44fe-4549-8919-a30bdb5b094c tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Action: 'create', calling method: .version_select at 0x7f4145e08c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-242282508", "metadata": {"Type": "work"}}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:36.137338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1834514780", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "0cfd4b2e-df56-43d0-908b-ea446d61e6b9"}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:36.747774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] validate_networks() for [('0cfd4b2e-df56-43d0-908b-ea446d61e6b9', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:19:37.247818 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2cbd1fd-44fe-4549-8919-a30bdb5b094c tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.888547 May 10 17:19:37.255593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1156 bytes} [Mon May 10 17:19:34 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 2899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 17:19:37.390222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-18bc78bb-f05a-47b8-8fb9-fcc9e30b3be6 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Action: 'create', calling method: .version_select at 0x7f4145d539d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1137145671"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:38.179221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-18bc78bb-f05a-47b8-8fb9-fcc9e30b3be6 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.921416 May 10 17:19:38.180272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 2/2] 10.222.0.32 () {60 vars in 1155 bytes} [Mon May 10 17:19:37 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 924 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 17:19:38.349453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b2f2cce0-ac19-4906-ba51-145ea93981e1 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Action: 'create', calling method: .version_select at 0x7f4145c0ad30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1358308855", "metadata": {"Type": "work"}}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:38.351652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b2f2cce0-ac19-4906-ba51-145ea93981e1 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:38.352728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b2f2cce0-ac19-4906-ba51-145ea93981e1 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171230 May 10 17:19:38.353504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 3/3] 10.222.0.32 () {60 vars in 1156 bytes} [Mon May 10 17:19:38 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:19:38.358581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b4abfa79-e7b5-49a1-ad8d-46f659d73728 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Calling method '.version_select at 0x7f4145c0af70>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:38.366834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:19:38.367301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:19:38.368578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:19:38.368871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:19:38.369958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:19:38.384498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:38.385213 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:38.386782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:38.387386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:38.414682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:38.422108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for user a32fb4db0ebb499a9cf1103e888cbbc6 and project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:38.435844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:19:38.439109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:19:38.484064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b4abfa79-e7b5-49a1-ad8d-46f659d73728 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9" status: 200 len: 352 microversion: 2.1 time: 0.129168 May 10 17:19:38.484938 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 4/4] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:38 2021] GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:38.554652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a81e32b3-fa86-4e96-bd3f-0a4b49d7210c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.749183 May 10 17:19:38.556154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-813924908", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "e9c9da18-88ea-4f01-9df5-4118e97e1a38"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:38.556539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 1/5] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:19:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 3753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:19:38.562890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-129b9d99-5b1e-4c7c-9f8d-9ef3076a844a tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145c16430>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:38.695350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] validate_networks() for [('e9c9da18-88ea-4f01-9df5-4118e97e1a38', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:19:38.776949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-129b9d99-5b1e-4c7c-9f8d-9ef3076a844a tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 200 len: 345 microversion: 2.1 time: 0.218069 May 10 17:19:38.778578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 2/6] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:38 2021] GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:38.783523 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-41cd8508-aa0f-4c4f-a5f9-7b83b18febfe tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Action: 'create', calling method: .version_select at 0x7f414531a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1662821084", "metadata": {"Type": "work"}}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:38.785261 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-41cd8508-aa0f-4c4f-a5f9-7b83b18febfe tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:38.789799 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-41cd8508-aa0f-4c4f-a5f9-7b83b18febfe tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009945 May 10 17:19:38.790605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 3/7] 10.222.0.32 () {60 vars in 1156 bytes} [Mon May 10 17:19:38 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:19:38.801547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95a8e3b6-de5f-4edf-8a50-953394d93a3c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:38.807134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95a8e3b6-de5f-4edf-8a50-953394d93a3c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:38.961934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95a8e3b6-de5f-4edf-8a50-953394d93a3c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:38.988513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95a8e3b6-de5f-4edf-8a50-953394d93a3c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1218 microversion: 2.1 time: 0.196015 May 10 17:19:38.999710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:38 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1218 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:39.008724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dab4732f-7234-4727-9bbf-5ce6fe4c50dc tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Action: 'create', calling method: .version_select at 0x7f41452f8a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-895108034", "metadata": {"Type": "work"}}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:39.011573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dab4732f-7234-4727-9bbf-5ce6fe4c50dc tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:39.013144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dab4732f-7234-4727-9bbf-5ce6fe4c50dc tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011582 May 10 17:19:39.013934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 5/9] 10.222.0.32 () {60 vars in 1156 bytes} [Mon May 10 17:19:38 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:19:39.025967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4298f9b9-b51a-405e-97ff-fa817e5e6a6c tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Calling method '.version_select at 0x7f4145306550>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:39.107450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-4298f9b9-b51a-405e-97ff-fa817e5e6a6c tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] HTTP exception thrown: Volume tempest-invalid-1627438112 could not be found. May 10 17:19:39.108448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4298f9b9-b51a-405e-97ff-fa817e5e6a6c tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 404 to user: Volume tempest-invalid-1627438112 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:39.109462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4298f9b9-b51a-405e-97ff-fa817e5e6a6c tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1627438112" status: 404 len: 99 microversion: 2.1 time: 0.090256 May 10 17:19:39.110479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 6/10] 10.222.0.32 () {58 vars in 1218 bytes} [Mon May 10 17:19:39 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1627438112 => generated 99 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 17:19:39.118998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4e638d61-2e36-4f7e-9233-0a37dfa55d93 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003690 May 10 17:19:39.120010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 7/11] 10.222.0.32 () {58 vars in 1140 bytes} [Mon May 10 17:19:39 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 17:19:39.172670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e7f0c612-8baf-481b-8392-b8bdd8af668a tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003607 May 10 17:19:39.173225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 8/12] 10.222.0.32 () {58 vars in 1137 bytes} [Mon May 10 17:19:39 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 10 17:19:39.182960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2102e97d-957b-43b2-b4ae-0080e7d65d99 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Calling method '.version_select at 0x7f41452f88b0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:39.279495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-2102e97d-957b-43b2-b4ae-0080e7d65d99 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] HTTP exception thrown: Volume 4c1559f9-b6a9-4939-9200-7346f917531e could not be found. May 10 17:19:39.280235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2102e97d-957b-43b2-b4ae-0080e7d65d99 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 404 to user: Volume 4c1559f9-b6a9-4939-9200-7346f917531e could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:39.281094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2102e97d-957b-43b2-b4ae-0080e7d65d99 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/4c1559f9-b6a9-4939-9200-7346f917531e" status: 404 len: 109 microversion: 2.1 time: 0.102357 May 10 17:19:39.281922 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 9/13] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:19:39 2021] DELETE /compute/v2.1/os-volumes/4c1559f9-b6a9-4939-9200-7346f917531e => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:19:39.291121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-339bf691-0c66-49cc-9daa-87ac9fbf0e04 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Calling method '.version_select at 0x7f41452f8670>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:39.393408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-339bf691-0c66-49cc-9daa-87ac9fbf0e04 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] HTTP exception thrown: Volume de725ffc-2d39-4525-a22c-43c10f285e89 could not be found. May 10 17:19:39.397762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-339bf691-0c66-49cc-9daa-87ac9fbf0e04 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] Returning 404 to user: Volume de725ffc-2d39-4525-a22c-43c10f285e89 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:39.399031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-339bf691-0c66-49cc-9daa-87ac9fbf0e04 tempest-VolumesNegativeTest-1363341241 tempest-VolumesNegativeTest-1363341241-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/de725ffc-2d39-4525-a22c-43c10f285e89" status: 404 len: 109 microversion: 2.1 time: 0.112202 May 10 17:19:39.400430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 10/14] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:39 2021] GET /compute/v2.1/os-volumes/de725ffc-2d39-4525-a22c-43c10f285e89 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:19:39.496761 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4407a543-0322-4a94-a182-e09160fb5a6c tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Calling method '.version_select at 0x7f41453063a0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:39.677622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4407a543-0322-4a94-a182-e09160fb5a6c tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9" status: 200 len: 353 microversion: 2.1 time: 0.184476 May 10 17:19:39.678210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 11/15] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:39 2021] GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:19:39.690121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6bcf9871-125a-45a4-80a0-0ad869895085 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Calling method '.version_select at 0x7f4145313310>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:39.731343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:19:39.732124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:19:39.732556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:19:39.732984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:19:39.733455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:19:39.754072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:39.754587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:39.755747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:39.758080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:39.803282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Getting quotas for project 6ad2c46a2acb4b4d94726b9d4662b49d. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:39.809005 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Getting quotas for user 230362c6442546df82f2a31e48dc0d90 and project 6ad2c46a2acb4b4d94726b9d4662b49d. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:39.822199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:19:39.825606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:19:39.831829 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6bcf9871-125a-45a4-80a0-0ad869895085 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9" status: 200 len: 353 microversion: 2.1 time: 0.146199 May 10 17:19:39.832405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 12/16] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:39 2021] GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:19:39.847795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8335540a-8fd4-4c20-93af-bb9c0ef0d5f9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f41453064c0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:40.004435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-55f2cc04-1d1d-4768-8506-b3312b3923aa tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.518270 May 10 17:19:40.005592 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 5/17] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:19:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:19:40.017861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-658df82b-b5c3-4b33-91d8-eb2074bef39f tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Calling method '.version_select at 0x7f4145aea040>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:40.037130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8335540a-8fd4-4c20-93af-bb9c0ef0d5f9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 200 len: 346 microversion: 2.1 time: 0.203652 May 10 17:19:40.037976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 13/18] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:39 2021] GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:40.048721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e7a83f07-e445-4f38-b8d4-36005d795c00 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:40.049673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e7a83f07-e445-4f38-b8d4-36005d795c00 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:40.250861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e7a83f07-e445-4f38-b8d4-36005d795c00 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:40.264630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e7a83f07-e445-4f38-b8d4-36005d795c00 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1218 microversion: 2.1 time: 0.225039 May 10 17:19:40.265232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 14/19] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:40 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:40.302174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e3d2d5d6-b325-46f2-9619-4d02dfd23bc7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:40.308719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-658df82b-b5c3-4b33-91d8-eb2074bef39f tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9" status: 202 len: 0 microversion: 2.1 time: 0.301618 May 10 17:19:40.309336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e3d2d5d6-b325-46f2-9619-4d02dfd23bc7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:40.309431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 6/20] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:19:40 2021] DELETE /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:19:40.317874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b6c56fd5-5ffc-47d4-8475-055f25e87b30 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Action: 'create', calling method: .version_select at 0x7f4145aeaa60>, body: {"snapshot": {"volume_id": "6a4b1d88-71fd-45b5-9137-945335f0f265", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-818673161"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:40.565338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e3d2d5d6-b325-46f2-9619-4d02dfd23bc7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:40.581012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e3d2d5d6-b325-46f2-9619-4d02dfd23bc7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1214 microversion: 2.1 time: 0.297454 May 10 17:19:40.587491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 15/21] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:40 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1214 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:40.637336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-51a6336c-12b4-4d35-a045-979f4dea23a7 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Calling method '.version_select at 0x7f4145306af0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.001154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b6c56fd5-5ffc-47d4-8475-055f25e87b30 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.687186 May 10 17:19:41.002385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 7/22] 10.222.0.32 () {60 vars in 1162 bytes} [Mon May 10 17:19:40 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:41.011687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0a65b1a9-a181-4fb8-97d4-628ae6af0d04 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145afa550>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.106662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-51a6336c-12b4-4d35-a045-979f4dea23a7 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] HTTP exception thrown: Volume f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 could not be found. May 10 17:19:41.106662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-51a6336c-12b4-4d35-a045-979f4dea23a7 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] Returning 404 to user: Volume f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:41.107360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-51a6336c-12b4-4d35-a045-979f4dea23a7 tempest-VolumesGetTestJSON-200530452 tempest-VolumesGetTestJSON-200530452-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9" status: 404 len: 109 microversion: 2.1 time: 0.519930 May 10 17:19:41.110232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 16/23] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:40 2021] GET /compute/v2.1/os-volumes/f9bbeab6-4c95-4060-97a4-c4addcf4e3f9 => generated 109 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:19:41.212025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0a65b1a9-a181-4fb8-97d4-628ae6af0d04 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.204362 May 10 17:19:41.215900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 8/24] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:41 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:41.227824 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e13ee3c7-a7fd-47cd-847a-eea94a413fce tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145306d30>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.283037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.283775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:41.308174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:41.308787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:41.310129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:41.310928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:41.337934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e13ee3c7-a7fd-47cd-847a-eea94a413fce tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.118027 May 10 17:19:41.339385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 17/25] 10.222.0.32 () {58 vars in 1140 bytes} [Mon May 10 17:19:41 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:41.353599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-77b009f5-f2bf-4820-bfef-e3ad8e8da1f2 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f41452f8f70>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.454275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-77b009f5-f2bf-4820-bfef-e3ad8e8da1f2 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.108079 May 10 17:19:41.454897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 18/26] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:41 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:19:41.607535 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:41.612392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:41.614852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:41.636371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:41.640080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:41.642934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:41.644138 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:41.649618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4a6c5aed-4573-4a13-a519-fa15a0c629d3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1270 microversion: 2.1 time: 0.370863 May 10 17:19:41.650453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 9/27] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:41 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1270 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:41.843203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:41.860848 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-271cdc88-d672-4380-8d25-47962595ea85 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1218 microversion: 2.1 time: 0.257562 May 10 17:19:41.868783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 19/28] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:41 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:42.468758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8a20d46d-633b-4497-ba16-c0463ab44c3d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145bbb280>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:42.536192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8a20d46d-633b-4497-ba16-c0463ab44c3d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.073544 May 10 17:19:42.536971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 10/29] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:42 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:42.667445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:42.668325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:42.676599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:42.677176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:42.678051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:42.678738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:42.820176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:42.830503 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5f3a2209-677c-4785-8f11-b0f1b900309b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1278 microversion: 2.1 time: 0.166859 May 10 17:19:42.831372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 20/30] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:42 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:42.878428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:42.879598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:42.887620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:42.888879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:42.889833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:42.890470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:43.008840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:43.018929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1a22b694-6f75-4501-8636-d51de06d2bd7 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1218 microversion: 2.1 time: 0.144085 May 10 17:19:43.020437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 11/31] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:42 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:43.565857 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-876c2518-043d-44ff-8250-162a3078cf89 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145256820>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:43.617029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-876c2518-043d-44ff-8250-162a3078cf89 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.071440 May 10 17:19:43.618238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 21/32] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:43 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:43.848220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:43.848889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:43.857611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:43.858373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:43.859405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:43.860020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:43.984635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:43.993931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f94dd6ba-47f6-4403-8b9f-ced66d42bc6d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1278 microversion: 2.1 time: 0.149711 May 10 17:19:43.995298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 12/33] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:43 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:44.037223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:44.038741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:44.052151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:44.053199 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:44.055246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:44.056152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:44.183510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:44.192082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-01911473-7644-4a38-9851-57a47cf82b34 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1218 microversion: 2.1 time: 0.159332 May 10 17:19:44.193019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 22/34] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:44 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:44.644194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-46fd5d39-0204-44ab-880a-f11e5d110792 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414521fc10>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:44.779923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-46fd5d39-0204-44ab-880a-f11e5d110792 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.154663 May 10 17:19:44.781218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 13/35] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:44 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:45.011612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:45.012194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:45.024297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:45.024769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:45.025575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:45.026028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:45.209707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:45.210330 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:45.227406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:45.229108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:45.230786 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:45.234458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:45.273139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:45.292576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-80141fe3-27f1-4de8-b8a7-b0d34b27a384 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1278 microversion: 2.1 time: 0.283717 May 10 17:19:45.294841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 23/36] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:45 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1278 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:45.519001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:45.527610 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-52926d1f-b171-4088-80a4-ba8ebeaed71e tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1218 microversion: 2.1 time: 0.322253 May 10 17:19:45.529348 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 14/37] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:45 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:45.842481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc10db62-4479-470e-938d-216bba7f2e21 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145256310>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:45.939205 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cc10db62-4479-470e-938d-216bba7f2e21 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.101487 May 10 17:19:45.951967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 24/38] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:45 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:46.309152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:46.310182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:46.323830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:46.324439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:46.326787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:46.330413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:46.545007 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:46.546271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:46.557939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:46.561703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:46.562769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:46.563746 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:46.611832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:46.624933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f7b922da-023e-4330-96be-22cc938002d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.319890 May 10 17:19:46.635999 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 15/39] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:46 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:46.954670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-53e4a91a-0355-436d-b951-484b892bb114 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414521fa60>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:46.990458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:47.007043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a601883f-ade9-4dc9-a4e9-26107b899c89 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1266 microversion: 2.1 time: 0.459578 May 10 17:19:47.017419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 25/40] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:46 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:47.090849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-53e4a91a-0355-436d-b951-484b892bb114 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 287 microversion: 2.1 time: 0.142716 May 10 17:19:47.091455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 16/41] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:46 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:47.104236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9d4b6a7f-3623-457a-88c9-89ce7b149be2 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414524d550>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:47.327710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9d4b6a7f-3623-457a-88c9-89ce7b149be2 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 202 len: 0 microversion: 2.1 time: 0.228913 May 10 17:19:47.328317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 26/42] 10.222.0.32 () {58 vars in 1254 bytes} [Mon May 10 17:19:47 2021] DELETE /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:19:47.336416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-76b0667d-206d-45cb-85c1-d8a77a5ed673 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414521f8b0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:47.456502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-76b0667d-206d-45cb-85c1-d8a77a5ed673 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.123653 May 10 17:19:47.457317 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 17/43] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:47 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:19:47.655499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:47.656221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:47.674025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:47.674534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:47.675352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:47.675816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:48.035824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:48.036469 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:48.068976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:48.070972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:48.076874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:48.078476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:48.135341 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:48.161860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ee57172b-0d84-4ea8-8d62-80bccb52a995 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.513969 May 10 17:19:48.164832 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 27/44] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:47 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:48.366036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:48.380244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bc561636-dc4e-48a3-8234-8c4d8eb2e6fe tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1266 microversion: 2.1 time: 0.358811 May 10 17:19:48.390147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 18/45] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:48 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:48.468285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d670efb6-e960-477f-90af-8b3d7cb025d6 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145afab80>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:48.550791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d670efb6-e960-477f-90af-8b3d7cb025d6 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.086095 May 10 17:19:48.552503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 19/46] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:48 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:48.632619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1148813165", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c40edc93-49fe-487d-9975-28a626203a59"}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:48.703440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] validate_networks() for [('c40edc93-49fe-487d-9975-28a626203a59', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:19:49.179693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:49.180324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:49.193790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:49.194169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:49.195003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:49.195450 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:49.456833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:49.469312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-45f1fba7-82c9-489a-a047-eec175bb2eaa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.293165 May 10 17:19:49.479372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 20/47] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:49 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:49.491504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:49.492422 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:49.502051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:49.502946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:49.503980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:49.504635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:49.680935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:49.692867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b2c7f451-888b-431a-8c8c-1df437703fbf tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1266 microversion: 2.1 time: 0.208110 May 10 17:19:49.694657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 21/48] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:49 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:49.713594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-841dae51-a4b1-4082-941e-86fbabcae8af tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f41452069d0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:49.765282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-841dae51-a4b1-4082-941e-86fbabcae8af tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.069358 May 10 17:19:49.766112 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 22/49] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:49 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:50.210750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:19:50.211826 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:19:50.212894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:19:50.213258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:19:50.213833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:19:50.224421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:50.225946 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:50.227445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:50.228655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:50.253896 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Getting quotas for project 7fc027d222ec41848aea01fc2452dce7. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:50.266775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Getting quotas for user 1f505641645b4d039311aafbcd24d6b9 and project 7fc027d222ec41848aea01fc2452dce7. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:50.287375 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:19:50.290179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:19:50.373659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-75d72033-1ed3-47bb-83ae-954f660cef14 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.939196 May 10 17:19:50.381314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 28/50] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:19:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:19:50.386138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b051c899-8f88-4157-81fb-d095788a1e1f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:50.386796 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b051c899-8f88-4157-81fb-d095788a1e1f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:50.493713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:50.497692 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:50.554481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:50.560855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:50.562311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:50.563250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:50.573098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b051c899-8f88-4157-81fb-d095788a1e1f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:50.591192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b051c899-8f88-4157-81fb-d095788a1e1f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1222 microversion: 2.1 time: 0.207591 May 10 17:19:50.596161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 23/51] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:50 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:51.022916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: .version_select at 0x7f4146564ca0>, body: {"keypair": {"name": "tempest-keypair-1664216596"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:51.063905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:51.085363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-97aab5d6-9abb-4205-8c88-bc54c622c6f9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.597790 May 10 17:19:51.086839 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 29/52] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:50 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:51.102575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:51.104570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:51.115217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:51.126079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:51.131819 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:51.132302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:51.133104 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:51.133560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:51.392286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:51.396507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:51.410991 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4c9f695c-5443-4154-b9ec-2da17e633faf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.813404 May 10 17:19:51.411673 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 24/53] 10.222.0.32 () {62 vars in 1199 bytes} [Mon May 10 17:19:50 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 815 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 10 17:19:51.424290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4a8e2083-0ab3-41d7-a652-a4e7def20661 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145275af0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:51.480037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4a8e2083-0ab3-41d7-a652-a4e7def20661 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 200 len: 286 microversion: 2.1 time: 0.061241 May 10 17:19:51.485613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 25/54] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:51 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:19:51.492380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2108977199", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c40edc93-49fe-487d-9975-28a626203a59"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:51.579624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] validate_networks() for [('c40edc93-49fe-487d-9975-28a626203a59', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:19:51.709494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:51.725929 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f3c76bec-1af5-47fc-879e-79871d39461f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1266 microversion: 2.1 time: 0.635017 May 10 17:19:51.727749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 30/55] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:51 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1266 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:52.103168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:52.103961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:52.131933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:52.132402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:52.139303 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:52.139917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:52.993237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:53.006736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-492862cd-e8fe-42e3-af06-56ba1f91dd6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.907138 May 10 17:19:53.015013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 31/56] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:52 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:53.020458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cec5a8cc-6228-4d21-bbdd-4de1490075cf tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414524daf0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:53.115908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-cec5a8cc-6228-4d21-bbdd-4de1490075cf tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] HTTP exception thrown: Snapshot 2671264e-283c-4e59-81f4-04f432f3b6b0 could not be found. May 10 17:19:53.116609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cec5a8cc-6228-4d21-bbdd-4de1490075cf tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Returning 404 to user: Snapshot 2671264e-283c-4e59-81f4-04f432f3b6b0 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:53.117644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cec5a8cc-6228-4d21-bbdd-4de1490075cf tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0" status: 404 len: 111 microversion: 2.1 time: 0.101557 May 10 17:19:53.118393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 32/57] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:19:53 2021] GET /compute/v2.1/os-snapshots/2671264e-283c-4e59-81f4-04f432f3b6b0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:19:53.123751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:53.131565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:53.160738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:53.161529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:53.162483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:53.163035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:53.747812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:19:53.748171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:19:53.748350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:19:53.749324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:19:53.749891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:19:53.771521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:53.772504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:53.776929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:53.777583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:53.843672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Getting quotas for project 7fc027d222ec41848aea01fc2452dce7. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:19:53.864494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Getting quotas for user 1f505641645b4d039311aafbcd24d6b9 and project 7fc027d222ec41848aea01fc2452dce7. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:19:53.888609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:19:53.891188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:19:54.023100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-13e59dc8-9b5a-4dd1-a853-81d003718705 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.535856 May 10 17:19:54.032949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:54.040053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 26/58] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:19:51 2021] POST /compute/v2.1/servers => generated 383 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:19:54.045431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d81560ad-2988-4725-b2a0-1db5b74f8204 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1266 microversion: 2.1 time: 0.922503 May 10 17:19:54.045431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 33/59] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:53 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1266 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:54.062967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-44a36fba-9eff-41b0-abc0-64eddadea5fb tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f41452521f0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:54.067289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:54.067918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:54.099250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:54.099711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:54.100509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:54.100957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:54.373559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-44a36fba-9eff-41b0-abc0-64eddadea5fb tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 202 len: 0 microversion: 2.1 time: 0.328671 May 10 17:19:54.374650 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 27/60] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:19:54 2021] DELETE /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:19:54.380011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-05bf9ee9-e25e-461f-8bda-eb34a86362d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:54.380779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-05bf9ee9-e25e-461f-8bda-eb34a86362d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:54.987305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:55.004479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bc25f0d7-c6f8-46da-8920-2cd1fab260a6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1276 microversion: 2.1 time: 0.957384 May 10 17:19:55.017131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 34/61] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:54 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1276 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:55.037852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eef9c02a-d0e4-4193-95b3-f80a4a392ca9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f4145256c10>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:55.102872 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-05bf9ee9-e25e-461f-8bda-eb34a86362d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:55.121393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-05bf9ee9-e25e-461f-8bda-eb34a86362d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1222 microversion: 2.1 time: 0.741648 May 10 17:19:55.130806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 28/62] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:54 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1222 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:55.145167 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:55.150510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:55.184226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:55.186962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:55.187808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:55.188264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:55.372755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-eef9c02a-d0e4-4193-95b3-f80a4a392ca9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] HTTP exception thrown: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. May 10 17:19:55.373679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eef9c02a-d0e4-4193-95b3-f80a4a392ca9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Returning 404 to user: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:55.374763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eef9c02a-d0e4-4193-95b3-f80a4a392ca9 tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 404 len: 109 microversion: 2.1 time: 0.355407 May 10 17:19:55.375324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 35/63] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:55 2021] GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 109 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:19:55.389196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cd7c193b-d3e5-4e16-a403-1047292e308e tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414524d160>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:55.606304 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-cd7c193b-d3e5-4e16-a403-1047292e308e tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] HTTP exception thrown: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. May 10 17:19:55.606952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cd7c193b-d3e5-4e16-a403-1047292e308e tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Returning 404 to user: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:55.607965 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cd7c193b-d3e5-4e16-a403-1047292e308e tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 404 len: 109 microversion: 2.1 time: 0.222723 May 10 17:19:55.608531 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 36/64] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:19:55 2021] DELETE /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 109 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:19:55.616476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-564fc095-8970-440a-9913-6b13f44c8e2d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Calling method '.version_select at 0x7f414524d430>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:55.850073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:55.863377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-67c544e1-dbbe-4e97-a7cb-a037c5a1fe0d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1274 microversion: 2.1 time: 0.732057 May 10 17:19:55.866763 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 29/65] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:55 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1274 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:56.022898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:56.023936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:56.037838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-564fc095-8970-440a-9913-6b13f44c8e2d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] HTTP exception thrown: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. May 10 17:19:56.038518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-564fc095-8970-440a-9913-6b13f44c8e2d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] Returning 404 to user: Volume 6a4b1d88-71fd-45b5-9137-945335f0f265 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:19:56.039358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-564fc095-8970-440a-9913-6b13f44c8e2d tempest-VolumesSnapshotsTestJSON-219716278 tempest-VolumesSnapshotsTestJSON-219716278-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265" status: 404 len: 109 microversion: 2.1 time: 0.426670 May 10 17:19:56.040236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 37/66] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:19:55 2021] GET /compute/v2.1/os-volumes/6a4b1d88-71fd-45b5-9137-945335f0f265 => generated 109 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:19:56.067655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.072578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.076666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.080014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.140283 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:56.141152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:56.165959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.170216 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.171272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.171917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.649369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:56.663609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cac24d09-2e1c-4302-911c-2babd8e0e014 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.525596 May 10 17:19:56.664259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 38/67] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:56 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:56.884078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:56.884933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:56.895685 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.899600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.900659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:56.903681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:56.911947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:56.923200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a7991c10-28da-4afd-83d6-8d4aee71001e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.904770 May 10 17:19:56.926414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 30/68] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:56 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:57.267683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:57.282374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fb3098e1-481d-4b4c-960b-eefd377672ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1274 microversion: 2.1 time: 0.402352 May 10 17:19:57.283381 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 39/69] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:56 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1274 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:19:57.685674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:57.688600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:57.718380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:57.721719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:57.728214 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:57.728997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:57.940156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:57.941214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:57.949182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:57.949789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:57.951126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:57.951840 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:57.968044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:57.986072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8fed8662-40d3-48d8-a225-c31dc5a31b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.308603 May 10 17:19:57.986947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 31/70] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:57 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:58.205656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1119032529", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a743af2b-ecde-4507-a08d-7e8e82f84011"}], "security_groups": [{"name": "tempest-securitygroup--2123996726"}], "key_name": "tempest-keypair-1664216596", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:19:58.664245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:58.673771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-121233d2-bca6-4af6-adf9-96238b606a21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.737213 May 10 17:19:58.674683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 40/71] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:57 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:58.679474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:58.680285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:58.688802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:58.689431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:58.690420 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:58.691003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:58.774460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] validate_networks() for [('a743af2b-ecde-4507-a08d-7e8e82f84011', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:19:58.849593 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:58.863221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cafdeea7-da7b-4637-9bec-14e110b55aef tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1274 microversion: 2.1 time: 0.187011 May 10 17:19:58.864151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 41/72] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:58 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:59.009073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:59.010969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:59.032169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:59.032901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:59.034083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:59.034888 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:59.255412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:19:59.274517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5cdbd765-4def-4cd7-bbdc-c23f0f591913 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.275152 May 10 17:19:59.284479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 42/73] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:58 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:19:59.691430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:19:59.692735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:19:59.703485 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:59.704573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:19:59.705563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:19:59.706623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.251571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:20:00.252234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:20:00.252784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:20:00.253643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:20:00.254078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:20:00.278053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.280289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.283206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.283206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.300440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:00.305376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:20:00.311806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:20:00.318797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ef0e5c0f-43cd-4181-be7f-77abca4727c0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.631924 May 10 17:20:00.319424 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 43/74] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:19:59 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:00.336146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:20:00.346581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:20:00.359158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:00.359782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:00.381545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.385185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.393622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.394167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.476339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-20bd2102-e7b8-4e0c-9fef-36e3b249fe56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.276064 May 10 17:20:00.482679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 32/75] 10.222.0.32 () {62 vars in 1188 bytes} [Mon May 10 17:19:58 2021] POST /compute/v2.1/servers => generated 402 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 10 17:20:00.494169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:00.495030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:00.508758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.509200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.516035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:00.516588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:00.788047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:00.816720 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f11effe3-f680-40ca-8b9b-5705f57a734c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.461150 May 10 17:20:00.817325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 44/76] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:00 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:00.833381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:00.850093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a6dc96c8-43cd-4033-a656-9ca057cba82b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.366036 May 10 17:20:00.852387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:00.853019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:00.855553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 33/77] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:00 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:00.989815 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:01.007651 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:01.009711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:01.015238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ef6bd0d0-bfdc-43e9-aded-8f1a9d66fe0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1282 microversion: 2.20 time: 0.189451 May 10 17:20:01.016043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 45/78] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:00 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:01.343233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:01.345101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:01.363503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.363997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:01.364837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.365290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:01.684956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:01.693864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-443e5788-3fe3-4581-92a1-9ef3f1156801 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.357069 May 10 17:20:01.694827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 34/79] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:01 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:01.834516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:01.835148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:01.848920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.850836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:01.852830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.853956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:01.873392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:01.874214 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:01.886140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.886630 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:01.887966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:01.888415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:02.183461 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:02.196311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54725cd3-b889-422d-b0b6-c28040de4b7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.365224 May 10 17:20:02.197906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 46/80] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:01 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:02.209802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:02.211095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:02.220656 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:02.221329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:02.222554 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:02.223583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:02.268953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:02.293296 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-de07187e-d9d5-445a-bdb3-fe68c10d4838 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.423903 May 10 17:20:02.296397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 35/81] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:01 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:02.480325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:02.493504 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:02.503696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:02.507675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-23e6d9f3-a9bf-48f9-8979-5a5d412adf4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1286 microversion: 2.20 time: 0.308469 May 10 17:20:02.518810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 47/82] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:02 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1286 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:02.725003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:02.726325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:02.747928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:02.761619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:02.762675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:02.763139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.152062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.175347 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-abad60f8-4579-4019-abf2-c4771debf1eb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.446611 May 10 17:20:03.185651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 36/83] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:02 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:03.222098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:03.224341 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:03.244571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.245037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.246179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.246994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.312490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:03.313368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:03.326495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.327180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.328330 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.329415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.509252 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.518326 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.522196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ecd9a3e7-cb82-4576-aa74-8c660e0a1e35 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.307000 May 10 17:20:03.523156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 48/84] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:03 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:03.527784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a75b6f2b-2a45-49bf-95c1-191eecffb414 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.219056 May 10 17:20:03.534718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 37/85] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:03 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:03.538477 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:03.543010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:03.550427 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.551004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.551925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:03.552577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:03.733664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.743499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.745514 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:03.761139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2c872e1f-fd3e-4a23-9394-192670fcc89a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1286 microversion: 2.20 time: 0.233228 May 10 17:20:03.761748 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 49/86] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:03 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:04.202439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:04.205126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:04.225436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.226099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.227179 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.227898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.535007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:04.539198 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:04.541197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:04.549196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-db1ecbde-c921-4675-b2fb-2bbcc77ef9ea tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.359841 May 10 17:20:04.551306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.551942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.552884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.553483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.558717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 38/87] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:04 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:04.564849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:04.565892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:04.574201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.575637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.576604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.577064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.761601 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:04.781013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-46c57d62-1617-4dc2-aa0f-22bfbb1286ec tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.245166 May 10 17:20:04.790494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 50/88] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:04 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:04.801204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:04.802041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:04.814705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.815976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.817169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:04.817951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:04.819666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:04.829859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b1f1c724-8534-486f-9893-4f337edc0fa4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.269190 May 10 17:20:04.831193 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 39/89] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:04 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:04.994299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:05.006898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:05.008432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:05.009516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-112cb676-8d9a-4801-ba7e-1ce0c489db63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1286 microversion: 2.20 time: 0.217851 May 10 17:20:05.010377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 51/90] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:04 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1286 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:05.565727 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:05.566274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:05.583103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.583595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:05.584421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.584923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:05.804750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:05.805549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:05.819560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.820031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:05.822226 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.823705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:05.858174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:05.886767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1eabb036-9a80-41bc-9a24-f11f93b7314c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.324025 May 10 17:20:05.889738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 40/91] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:05 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:05.911508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:05.916808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:05.926538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.927888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:05.929132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:05.930058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:06.043574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:06.059219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3e4cfbf2-2739-4720-b15a-87cbba2d9a4f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.262029 May 10 17:20:06.059801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 52/92] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:05 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:06.082196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:06.084784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:06.123465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:06.124170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:06.125110 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:06.125692 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:06.180137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:06.199097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4f2339f3-3e13-441a-9f71-f780ab9ac07f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.307747 May 10 17:20:06.210003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 41/93] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:05 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:06.323415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:06.336386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:06.342419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:06.343710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7d42afe1-fb27-465f-8f38-a424e080e6db tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1286 microversion: 2.20 time: 0.265438 May 10 17:20:06.346802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 53/94] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:06 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1286 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:06.905586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:06.906971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:06.915785 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:06.916569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:06.917681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:06.918333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.077671 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:07.078479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:07.086234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.086842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.087793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.088372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.266548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.274866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2860d7f9-058b-473d-a194-918c6af2bbb4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1284 microversion: 2.1 time: 0.202609 May 10 17:20:07.275443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 54/95] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:07 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:07.286807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:07.287520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:07.295694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.296151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.296942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.297392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.436190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.444851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5580c01c-f9d0-4e31-a356-02a9aecb05d9 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.543549 May 10 17:20:07.445825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 42/96] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:06 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:07.451278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:07.451899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:07.453754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.460156 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.460973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.462080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:07.462703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-006e1e0f-3cac-4d70-8079-5bb4927e142c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.180088 May 10 17:20:07.463176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:07.463786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 55/97] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:07 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:07.583639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.594130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.595645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:07.596745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-956834e1-5a7d-40bf-8997-6f420f565ace tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1286 microversion: 2.20 time: 0.149783 May 10 17:20:07.597319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 43/98] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:07 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1286 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:08.294207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:08.295640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:08.316285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.317059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:08.318054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.318675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:08.462990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:08.464322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:08.485508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.487683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:08.489450 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.491699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:08.537682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:08.549347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-97412c95-0741-42ec-b286-6b1939533c7c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1272 microversion: 2.1 time: 0.261074 May 10 17:20:08.552678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 56/99] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:08 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:08.561684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:08.564702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:08.582438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.583308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:08.586142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:08.586867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:09.014605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:09.025782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a8b51267-58ce-497c-9120-93c8cf74b849 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1218 microversion: 2.1 time: 0.471686 May 10 17:20:09.026363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 57/100] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:08 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1218 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:09.041310 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:09.042081 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:09.050987 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:09.051682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:09.052473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:09.052913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:09.212644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:09.228728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:09.230302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:09.234549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c7e41777-5d8f-4e5f-96bd-c705708dd659 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1278 microversion: 2.20 time: 0.197322 May 10 17:20:09.247662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 58/101] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:09 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:09.569061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:09.569745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:09.579810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:09.580374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:09.581516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:09.582088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:09.677960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:09.694500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3a9acbad-7b6a-43c2-a65d-de2cf7820d80 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 1.235783 May 10 17:20:09.695408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 44/102] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:08 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:10.044000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:10.044850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:10.059830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.060299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:10.061097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.061545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:10.437083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:10.458723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-81dfa942-a5a4-4891-87b5-8d64a10cc640 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1292 microversion: 2.1 time: 0.415170 May 10 17:20:10.461230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 45/103] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:10 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1292 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:10.484304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:10.484953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:10.495546 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.496299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:10.497869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.498554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:10.759018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:10.794175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-237b798f-65ae-4cfe-8791-f1b483e5890d tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 1.208502 May 10 17:20:10.794968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 59/104] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:09 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:10.799761 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:10.806531 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:10.831111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.835931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:10.836800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:10.837260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:11.062981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:11.080627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:11.085764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:11.088670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-33b569c3-2afc-44ca-8a23-4b16ce704231 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1342 microversion: 2.20 time: 0.616751 May 10 17:20:11.089884 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 46/105] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:10 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1342 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:11.477731 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:11.478383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:11.495740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:11.496222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:11.497675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:11.498283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:11.731680 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:11.746676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-52331b69-23ae-4648-af73-dcb3c71a6cd0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1280 microversion: 2.1 time: 0.271245 May 10 17:20:11.749837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 47/106] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:11 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1280 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:11.811744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:11.812575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:11.825211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:11.825687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:11.833055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:11.833055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.257694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:12.268350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2ba85a7a-dba8-4198-8bd0-cfd20561d7b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 1.472100 May 10 17:20:12.271058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 60/107] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:10 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:12.513622 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:12.522396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2b2728d7-aac1-42e2-a98a-45ec5d9a4c73 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.714776 May 10 17:20:12.523559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 48/108] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:11 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:12.528487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:12.529517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:12.536941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.537670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.538703 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.539555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.598654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-e01f9e78-9688-456d-96ab-a2143584eb70 req-27a43841-e57e-4130-90af-8e5613d1e99b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92dbb526-fe62-4eea-a99c-fb8105f3438c", "tag": "eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:12.601124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:12.601124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:12.614511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-e01f9e78-9688-456d-96ab-a2143584eb70 req-27a43841-e57e-4130-90af-8e5613d1e99b service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.615520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-e01f9e78-9688-456d-96ab-a2143584eb70 req-27a43841-e57e-4130-90af-8e5613d1e99b service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.637455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-e01f9e78-9688-456d-96ab-a2143584eb70 req-27a43841-e57e-4130-90af-8e5613d1e99b service nova] Creating event network-changed:eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4 for instance 92dbb526-fe62-4eea-a99c-fb8105f3438c on hv-cinder-78638 May 10 17:20:12.638372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-e01f9e78-9688-456d-96ab-a2143584eb70 req-27a43841-e57e-4130-90af-8e5613d1e99b service nova] Acquired lock "compute-rpcapi-router" {{(pid=92810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 10 17:20:12.639747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.640431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.641848 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.642505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.659733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.compute.rpcapi [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 10 17:20:12.661463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] Releasing lock "compute-rpcapi-router" {{(pid=92810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 10 17:20:12.688934 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:12.693051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4dd41dc5-02c6-4656-8159-cffaa0777400 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420458 May 10 17:20:12.694026 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 61/109] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:12.700512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:12.702055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:12.703184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-999672ad-3621-4078-a1f0-e59d2c9191bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1340 microversion: 2.20 time: 0.178205 May 10 17:20:12.703775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 49/110] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:12 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1340 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:12.764374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:12.765284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:12.775361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.778312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:12.779387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:12.780077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.115675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:13.125232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aa109e00-826f-4d4c-94a8-14e92378cc4c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.364974 May 10 17:20:13.127122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 62/111] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:12 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:13.193090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-d6ee2df1-914b-4657-a91e-7ea5542e701d req-fd61d223-5877-4f1f-80dd-2a32ca083e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b022bb70-cca1-48d9-98cc-c4f53580a1b9", "tag": "7a435a01-5e96-4ca5-bec4-fb27c4859172"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:13.195352 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:13.195352 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:20:13.206693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d6ee2df1-914b-4657-a91e-7ea5542e701d req-fd61d223-5877-4f1f-80dd-2a32ca083e21 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.207795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d6ee2df1-914b-4657-a91e-7ea5542e701d req-fd61d223-5877-4f1f-80dd-2a32ca083e21 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.229053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-d6ee2df1-914b-4657-a91e-7ea5542e701d req-fd61d223-5877-4f1f-80dd-2a32ca083e21 service nova] Creating event network-changed:7a435a01-5e96-4ca5-bec4-fb27c4859172 for instance b022bb70-cca1-48d9-98cc-c4f53580a1b9 on hv-cinder-78638 May 10 17:20:13.229813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d6ee2df1-914b-4657-a91e-7ea5542e701d req-fd61d223-5877-4f1f-80dd-2a32ca083e21 service nova] Acquired lock "compute-rpcapi-router" {{(pid=92809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 10 17:20:13.231230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.231866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.232881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.233506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.243365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.compute.rpcapi [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 10 17:20:13.244496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] Releasing lock "compute-rpcapi-router" {{(pid=92809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 10 17:20:13.278505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5992a771-2f8f-4a70-b2f8-da4efd8c9276 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190679 May 10 17:20:13.278505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 50/112] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:13.289048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:13.290116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:13.298498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.298768 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.299554 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.300343 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.541108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:13.542914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:13.560251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.563020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.564004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.565079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.610513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:13.623540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0935aa04-855f-4817-9479-dd9cce2b0d92 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.337976 May 10 17:20:13.625535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 63/113] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:13 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:13.720969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:13.721601 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:13.736245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.736778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.738072 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:13.738566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:13.929799 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:13.939906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:13.941446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:13.952300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-12e89821-cbea-4bc9-a194-2c37180649da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1340 microversion: 2.20 time: 0.232709 May 10 17:20:13.954377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 64/114] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:13 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1340 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:20:14.056478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:14.078373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b9f77cf2-29b2-44b4-9807-54d7ab591305 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.541822 May 10 17:20:14.087830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 51/115] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:13 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:14.145501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:14.146360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:14.159263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.160847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:14.163150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.164424 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:14.550521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:14.559758 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-686499b3-bbee-41b7-8250-532df1cbc32d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.419819 May 10 17:20:14.562380 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 65/116] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:14 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:14.643472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:14.646231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:14.656345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.657596 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:14.658672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.660768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:14.891070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:14.904054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9a631832-d619-4873-9585-f6b9efdd8dbd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.266751 May 10 17:20:14.908375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 52/117] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:14 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:14.971106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:14.971731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:14.984853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.985319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:14.989445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:14.990197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.096560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:15.097461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:15.110657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.111648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.113968 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.114825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.835571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:15.845990 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:15.847726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:15.849197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1d6f324d-273a-40f9-81e6-b6b7eb21e26c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.881984 May 10 17:20:15.849847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 66/118] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:14 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:15.854861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:15.855774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:15.856722 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:15.864873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.865636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.866596 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5e8668fd-6f37-4afd-8fe2-a667d1a10419 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.774433 May 10 17:20:15.866903 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.875791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 53/119] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:15 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:15.875963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.922477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:15.923117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:15.931068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.931531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:15.932373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:15.932833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:16.804490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:16.821392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f3f38db9-86d7-4119-b99f-0ce7affde89c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.902980 May 10 17:20:16.823393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 54/120] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:15 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:16.871989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:16.873888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:16.875884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:16.885968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7d4514ae-7884-4b8f-af15-ed6df899cfcf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 1.034784 May 10 17:20:16.886498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:16.887284 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:16.890328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:16.891573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:16.896775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 67/121] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:15 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:16.909721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:16.910597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:16.937825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:16.937825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:16.937825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:16.942246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:18.004969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:18.017137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:18.018709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:18.019829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ff6036a4-3854-4b4a-ac99-6c2837d9296b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 1.154685 May 10 17:20:18.034759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 55/122] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:16 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:18.050279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-77f2c7b3-529e-452d-8050-927de4e2cf28 req-1c9f4434-e491-4d0d-a560-0564b4fcb200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca99c621-cf4f-4224-b16f-83b403a4e810", "tag": "b561183d-3956-4826-8e0f-46690d4b1fa6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:18.053164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:18.053164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:20:18.070570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-77f2c7b3-529e-452d-8050-927de4e2cf28 req-1c9f4434-e491-4d0d-a560-0564b4fcb200 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:18.075444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-77f2c7b3-529e-452d-8050-927de4e2cf28 req-1c9f4434-e491-4d0d-a560-0564b4fcb200 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:18.101789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:18.111296 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-77f2c7b3-529e-452d-8050-927de4e2cf28 req-1c9f4434-e491-4d0d-a560-0564b4fcb200 service nova] Creating event network-changed:b561183d-3956-4826-8e0f-46690d4b1fa6 for instance ca99c621-cf4f-4224-b16f-83b403a4e810 on hv-cinder-78638 May 10 17:20:18.119327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-77f2c7b3-529e-452d-8050-927de4e2cf28 req-1c9f4434-e491-4d0d-a560-0564b4fcb200 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083228 May 10 17:20:18.120090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 56/123] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:18.127849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-16884983-f6d0-42c2-b1f7-9f57b662183a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 1.229468 May 10 17:20:18.128560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 68/124] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:16 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:18.129411 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:18.130128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:18.139853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:18.140436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:18.143812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:18.144611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:18.147330 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:18.149490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:18.160721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:18.161396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:18.162357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:18.162948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:19.278415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:19.293740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bbfd793c-1390-45b1-92f0-4ffb22c90c74 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 1.162462 May 10 17:20:19.307916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:19.312629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 69/125] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:18 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:19.325257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e2271ef9-baae-496f-8a50-34856f068cb0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 1.203210 May 10 17:20:19.338632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 57/126] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:18 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:19.342035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-b6f442c9-20a0-419f-8d28-759ce7f43a7b req-d1bf9036-2c2b-4786-9f9d-33606516b12d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568c5267-2f2c-4d3b-8364-a05c2b8192b1", "tag": "efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:19.344012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:19.344012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:19.348588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:19.349223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:19.364659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b6f442c9-20a0-419f-8d28-759ce7f43a7b req-d1bf9036-2c2b-4786-9f9d-33606516b12d service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:19.365117 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b6f442c9-20a0-419f-8d28-759ce7f43a7b req-d1bf9036-2c2b-4786-9f9d-33606516b12d service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:19.372644 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:19.373135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:19.373962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:19.374434 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:19.406073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-b6f442c9-20a0-419f-8d28-759ce7f43a7b req-d1bf9036-2c2b-4786-9f9d-33606516b12d service nova] Creating event network-changed:efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd for instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 on hv-cinder-78638 May 10 17:20:19.427506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-b6f442c9-20a0-419f-8d28-759ce7f43a7b req-d1bf9036-2c2b-4786-9f9d-33606516b12d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110847 May 10 17:20:19.430288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 70/127] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:19.446121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:19.448555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:19.467842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:19.469840 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:19.472499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:19.475033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:20.272000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:20.275933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:20.285505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c050333c-bf75-4738-acad-807dfc777f74 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.852653 May 10 17:20:20.287075 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 71/128] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:19 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:20.300819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:20.302292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-10d78850-bbf1-44e0-8663-0519460bcb1a req-8744ea0e-cf92-4690-999f-f68c1faee7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:20.304643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:20.304643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:20.311687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:20.312947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4c9f7699-8d04-4237-bc07-8450cb34dcfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.973202 May 10 17:20:20.314118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 58/129] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:19 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:20.317288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-10d78850-bbf1-44e0-8663-0519460bcb1a req-8744ea0e-cf92-4690-999f-f68c1faee7d9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:20.317743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-10d78850-bbf1-44e0-8663-0519460bcb1a req-8744ea0e-cf92-4690-999f-f68c1faee7d9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:20.330020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:20.331250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:20.336559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-10d78850-bbf1-44e0-8663-0519460bcb1a req-8744ea0e-cf92-4690-999f-f68c1faee7d9 service nova] Creating event network-changed:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:20:20.341846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-10d78850-bbf1-44e0-8663-0519460bcb1a req-8744ea0e-cf92-4690-999f-f68c1faee7d9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053202 May 10 17:20:20.342747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 72/130] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:20.343832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:20.344488 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:20.345902 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:20.346459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:20.351315 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:20.352221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:20.361243 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:20.361889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:20.362878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:20.363469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:21.142109 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:21.154626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:21.173423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3b0db886-1c43-4d41-be05-4f552c9b8d6f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.823926 May 10 17:20:21.175078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bdd21ccd-907b-40c3-8752-1f39047c91da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.846868 May 10 17:20:21.175579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 73/131] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:20 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:21.186130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 59/132] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:20 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:21.304729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:21.305816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:21.318847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:21.320505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:21.321447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:21.322298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:21.334323 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:21.335623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:21.351407 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:21.354304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:21.358801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:21.359425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:22.140732 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.151556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0c342d1f-4b46-4e7c-9647-764144134aba tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.849597 May 10 17:20:22.153025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 74/133] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:21 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:22.191871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:22.192787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:22.199838 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.223642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.225392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.226168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:22.227354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:22.232848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-480dbf87-9fd9-49f4-9e24-95e9fb76321c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.902392 May 10 17:20:22.233133 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:22.234405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 60/134] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:21 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:20:22.234579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:22.250762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:22.262682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:22.275191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:22.276360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:22.277476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:22.282981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:22.860388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.867529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:22.871397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ee82bdcf-c80d-4d45-ba7c-6ec3fecc4bf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.634112 May 10 17:20:22.872066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 61/135] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:22 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:22.877186 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-84dfa5c5-2da2-4f3a-a724-278b0145bd21 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.690051 May 10 17:20:22.886645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 75/136] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:22 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:23.168343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:23.168970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:23.179813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.180275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.181068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.181523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.251985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:23.252839 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:23.260633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.261141 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.262518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.263128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.694124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:23.709836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1ee71570-23e1-425b-bb74-b3da003f03c3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.545050 May 10 17:20:23.711556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 62/137] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:23 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:23.749183 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:23.765828 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:23.770088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:23.771493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-27cd2925-6973-4be6-887a-9adfd6f7c38d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.523223 May 10 17:20:23.774695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 76/138] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:23 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:23.887639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:23.888552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:23.895521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:23.896655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:23.900518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.900994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.904410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.912712 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.923744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.924771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:23.927772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:23.928443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:24.455816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:24.466731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e28c55ea-ff76-4568-af07-6d0677cbef60 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.576979 May 10 17:20:24.467971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 77/139] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:23 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:24.501757 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:24.510843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7d5e3cb2-bd82-48ae-90b6-5da237f07446 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.627123 May 10 17:20:24.519549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 63/140] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:23 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:24.729579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:24.731675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:24.742952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:24.743897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:24.744843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:24.745438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:24.792799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:24.794118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:24.806510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:24.806955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:24.807753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:24.808199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:25.206908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:25.224411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fc0b378a-8d19-450c-b6d5-1e837fcf7295 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.498858 May 10 17:20:25.237779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 78/141] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:24 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:25.304903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:25.319123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:25.321472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:25.322675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7bfdc7fa-49ab-48bf-a82c-f6008a7066da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.533864 May 10 17:20:25.323677 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 64/142] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:24 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:20:25.487004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:25.487734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:25.509111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:25.514476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:25.515449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:25.515988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:25.534515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:25.535600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:25.548669 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:25.549793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:25.551049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:25.551665 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.044306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.052369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.053039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9c83214b-c601-420b-98d5-88b261e3490a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.572921 May 10 17:20:26.064880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0673e161-626e-451c-8d1c-585c4907bbca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.534937 May 10 17:20:26.066767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 79/143] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:25 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:26.069669 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 65/144] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:25 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:26.245071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:26.246601 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:26.262595 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:26.263316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.266100 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:26.267449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.329737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-ce6e6771-2d48-4d12-8b70-6a413ec2be60 req-10904bf8-bd7e-45f9-8364-633ac77feaf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dbb526-fe62-4eea-a99c-fb8105f3438c", "name": "network-vif-plugged", "status": "completed", "tag": "eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:26.331529 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:26.331529 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:20:26.351306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ce6e6771-2d48-4d12-8b70-6a413ec2be60 req-10904bf8-bd7e-45f9-8364-633ac77feaf6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:26.351975 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ce6e6771-2d48-4d12-8b70-6a413ec2be60 req-10904bf8-bd7e-45f9-8364-633ac77feaf6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.375666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-ce6e6771-2d48-4d12-8b70-6a413ec2be60 req-10904bf8-bd7e-45f9-8364-633ac77feaf6 service nova] Creating event network-vif-plugged:eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4 for instance 92dbb526-fe62-4eea-a99c-fb8105f3438c on hv-cinder-78638 May 10 17:20:26.382702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-ce6e6771-2d48-4d12-8b70-6a413ec2be60 req-10904bf8-bd7e-45f9-8364-633ac77feaf6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138711 May 10 17:20:26.383699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 66/145] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:26.391685 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:26.392620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:26.405108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:26.406249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.407793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:26.408389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:26.853348 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.862594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.868899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.872588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:26.875893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5f6f8224-dc11-4db7-9ccb-9d675ad58041 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.490067 May 10 17:20:26.876219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f5b820cf-4004-4bc7-9014-eb9927fc5b20 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.635884 May 10 17:20:26.877124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 80/146] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:26 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:26.878675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 67/147] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:26 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:27.068866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:27.069816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:27.085526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:27.086159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:27.104757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.105256 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.111510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.112049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.112782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.113575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.116259 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.120565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.714116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:27.726189 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:27.726696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-412d9ea0-a164-4f57-ad8e-2594d7ecaedd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.661090 May 10 17:20:27.729529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 81/148] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:27 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:27.737737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0b302f14-ba66-42f9-b8c6-3184912f3aea tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.656628 May 10 17:20:27.738637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 68/149] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:27 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:27.894834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:27.895476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:27.907064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:27.908244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:27.912701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.913443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.914417 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.915210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.919258 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.920483 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:27.921337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:27.921906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:28.313827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:28.323984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2e98e506-8d40-4a3f-8580-6580d8e69b88 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.432876 May 10 17:20:28.325537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 82/150] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:27 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:28.374044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:28.383634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:28.385611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:28.386886 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6b268ef8-a3f8-4bb6-9e8a-0efd77babb21 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.485974 May 10 17:20:28.390472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 69/151] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:27 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:28.416769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-8d1c88ba-8f56-49b9-ad02-129ee623ec49 req-f4f9362b-29c5-49ab-bac9-f246e8363cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b022bb70-cca1-48d9-98cc-c4f53580a1b9", "name": "network-vif-plugged", "status": "completed", "tag": "7a435a01-5e96-4ca5-bec4-fb27c4859172"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:28.419795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:28.419795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:28.429934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-8d1c88ba-8f56-49b9-ad02-129ee623ec49 req-f4f9362b-29c5-49ab-bac9-f246e8363cd7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:28.430537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-8d1c88ba-8f56-49b9-ad02-129ee623ec49 req-f4f9362b-29c5-49ab-bac9-f246e8363cd7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:28.447741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-8d1c88ba-8f56-49b9-ad02-129ee623ec49 req-f4f9362b-29c5-49ab-bac9-f246e8363cd7 service nova] Creating event network-vif-plugged:7a435a01-5e96-4ca5-bec4-fb27c4859172 for instance b022bb70-cca1-48d9-98cc-c4f53580a1b9 on hv-cinder-78638 May 10 17:20:28.453625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-8d1c88ba-8f56-49b9-ad02-129ee623ec49 req-f4f9362b-29c5-49ab-bac9-f246e8363cd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040692 May 10 17:20:28.454282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 83/152] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:28.747076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:28.748984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:28.757537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:28.758928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:28.765649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:28.766120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:28.769729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:28.770211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:28.771664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:28.772140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:28.772948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:28.773401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:29.222983 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:29.236417 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cc354740-4004-4f8f-8075-845479edb364 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.482874 May 10 17:20:29.249516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 84/153] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:28 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:29.267662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:29.281661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-58ab6a61-6688-4381-ae3c-06827c514c6c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.537906 May 10 17:20:29.284624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 70/154] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:28 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:29.345978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:29.346684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:29.357511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:29.357970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:29.358792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:29.359237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:29.414469 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:29.415187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:29.428414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:29.432716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:29.434810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:29.435435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.015371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.030960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.032779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.034056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e7bf2ff2-7a6b-407f-8d3f-fbd9da43f601 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.623772 May 10 17:20:30.037024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 71/155] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:29 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:20:30.047072 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.059115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3488fb61-03e8-4147-b5ab-b4d6c49abb3f tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1314 microversion: 2.1 time: 0.715919 May 10 17:20:30.060642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 85/156] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:29 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:30.255822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:30.256456 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:30.265408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:30.266062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.267573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:30.268211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.299443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:30.300328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:30.310610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:30.311291 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.312299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:30.312935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.735764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.750183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a593ed9f-fe56-495c-93db-5b1568d780c8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.498036 May 10 17:20:30.751546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:30.752117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 72/157] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:30 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:30.759980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "name": "network-vif-plugged", "status": "completed", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}, {"server_uuid": "ca99c621-cf4f-4224-b16f-83b403a4e810", "name": "network-vif-plugged", "status": "completed", "tag": "b561183d-3956-4826-8e0f-46690d4b1fa6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:30.762655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:30.762655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:20:30.773185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-335a8d60-a848-457f-953b-897ffafc87c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1318 microversion: 2.1 time: 0.476432 May 10 17:20:30.774533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:30.775216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:30.789012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 86/158] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:30 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:30.797182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] Creating event network-vif-plugged:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:20:30.797991 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] Creating event network-vif-plugged:b561183d-3956-4826-8e0f-46690d4b1fa6 for instance ca99c621-cf4f-4224-b16f-83b403a4e810 on hv-cinder-78638 May 10 17:20:30.809582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-59f4a3b9-0d43-416d-8c28-011d5b2c05a9 req-6491302f-4883-4815-a491-39a498250677 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054702 May 10 17:20:30.810679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 73/159] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:30 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:31.056034 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:31.057637 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:31.077840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:31.078706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:31.087206 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.088797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.089821 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.092170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.106823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.107634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.111351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.112354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.500401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:31.508613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:31.509758 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:31.511334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:31.513009 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b77df8fb-b030-4be4-aebd-1d636ae6e586 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.461822 May 10 17:20:31.513901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 87/160] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:31 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:31.521350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-22d1def0-2d2a-4dda-ba11-fcfde79fb511 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1502 microversion: 2.1 time: 0.448619 May 10 17:20:31.522131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 74/161] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:31 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:31.768577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:31.769416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:31.778610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.779430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.780456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.780916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.792632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:31.794048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:31.803263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.803985 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:31.805222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:31.806025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:32.163196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:32.174988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0e1c1df8-c40e-49c5-85e1-ff506faa7b4f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1507 microversion: 2.1 time: 0.386636 May 10 17:20:32.175569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 75/162] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:31 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:32.207559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:32.219016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5ba20d77-0bb7-4139-b438-8b3559f86df7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.454383 May 10 17:20:32.219973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 88/163] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:31 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:32.534956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:32.535698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:32.549518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:32.550267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:32.551308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:32.552099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:32.834984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-424738af-04fb-412c-a602-d5fe994f1c2c req-0515f2a7-ddef-45c5-b740-89d0231f5ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568c5267-2f2c-4d3b-8364-a05c2b8192b1", "name": "network-vif-plugged", "status": "completed", "tag": "efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:32.837540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:32.837540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:32.869176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-424738af-04fb-412c-a602-d5fe994f1c2c req-0515f2a7-ddef-45c5-b740-89d0231f5ef3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:32.870020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-424738af-04fb-412c-a602-d5fe994f1c2c req-0515f2a7-ddef-45c5-b740-89d0231f5ef3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:32.901213 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-424738af-04fb-412c-a602-d5fe994f1c2c req-0515f2a7-ddef-45c5-b740-89d0231f5ef3 service nova] Creating event network-vif-plugged:efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd for instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 on hv-cinder-78638 May 10 17:20:32.907438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:32.909568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-424738af-04fb-412c-a602-d5fe994f1c2c req-0515f2a7-ddef-45c5-b740-89d0231f5ef3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079716 May 10 17:20:32.910518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 89/164] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:32.916698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:32.918293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:32.920354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b809cc73-20b3-4862-8e39-620c6f7c7146 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.391032 May 10 17:20:32.921882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 76/165] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:32 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:33.133002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d7d1fee-243a-4731-b1bb-a7acdbe98988"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:33.135165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:33.146870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.158947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:33.159845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.160307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:33.243966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:33.254714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:33.264181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.265077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:33.266588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.267421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:33.532024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:33.540466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-745942f4-a973-4e68-b972-5f1c034d4ced tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1322 microversion: 2.1 time: 0.306630 May 10 17:20:33.541167 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 77/166] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:33 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:33.852792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95af3424-b52b-4c5a-be0b-dabffa3049f8"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:33.854033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:33.863222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.863827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:33.864686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:33.865282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.067028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-31cf06aa-497b-4f73-9fd2-9c93aace807c tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "POST /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938649 May 10 17:20:34.076919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 90/167] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:20:33 2021] POST /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:34.083916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:34.084639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:34.122898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.122898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.123297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.130067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.457016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:34.471774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:34.474182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:34.475919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9d35e2eb-a0c8-477f-be52-fbf851aed8c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1408 microversion: 2.20 time: 0.396742 May 10 17:20:34.477133 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 91/168] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:34 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1408 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:34.557421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:34.557961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:34.567102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.567817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.569445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.570107 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.825909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:34.835411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f309f258-ba7d-4aad-95e5-fa3eac197ffb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1515 microversion: 2.1 time: 0.281555 May 10 17:20:34.847707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 92/169] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:34 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:34.853579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:34.854639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:34.863259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.863722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.864522 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:34.864969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:34.931234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'flavor' on Instance uuid ca99c621-cf4f-4224-b16f-83b403a4e810 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:20:34.950328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4d9f811d-f95c-4495-9fda-7e4b2c091a31 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.090679 May 10 17:20:34.953036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 78/170] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:20:33 2021] POST /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:20:35.182689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b1f2779a-fc2a-4828-bfe9-c89721f55821 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810/action" status: 200 len: 32 microversion: 2.1 time: 0.333185 May 10 17:20:35.184089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 93/171] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:20:34 2021] POST /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:20:35.193935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:35.194668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:35.204412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.205162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.206151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.206684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.415463 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:35.424561 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e3fc182c-0cb9-4e29-8c32-e3258e4409ae tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.234799 May 10 17:20:35.425143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 79/172] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:35 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:35.496270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:35.497061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:35.514624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.515092 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.516139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.516591 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.728521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:35.738802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:35.740402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:35.741731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fd317e53-7524-43ff-90c9-b18c6681d96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1600 microversion: 2.20 time: 0.249949 May 10 17:20:35.742278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 94/173] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:20:35 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1600 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:35.760208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:35.760752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:35.768740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.769203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.769986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:35.770654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:35.923494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f5ce092b-9975-4015-a631-9c1f27b089a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.166141 May 10 17:20:35.923494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 80/174] 10.222.0.32 () {60 vars in 1316 bytes} [Mon May 10 17:20:35 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:20:36.442954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:36.456774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:36.466076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:36.466668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:36.468248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:36.468955 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:36.950282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:36.958956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7396e4db-1cb2-4457-a817-cb9e1c9249df tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.520712 May 10 17:20:36.959517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 95/175] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:36 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:37.702729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-b29015e4-f4d7-48a3-b667-ccdc27ba29ce req-84b6de92-9a0a-4960-9162-b0ae7d16dfae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:37.704392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:20:37.704392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:20:37.704836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:37.706318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:37.712928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b29015e4-f4d7-48a3-b667-ccdc27ba29ce req-84b6de92-9a0a-4960-9162-b0ae7d16dfae service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:37.713081 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b29015e4-f4d7-48a3-b667-ccdc27ba29ce req-84b6de92-9a0a-4960-9162-b0ae7d16dfae service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:37.716750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:37.717634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:37.719383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:37.720050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:37.736191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-b29015e4-f4d7-48a3-b667-ccdc27ba29ce req-84b6de92-9a0a-4960-9162-b0ae7d16dfae service nova] Creating event network-changed:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:20:37.737548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-b29015e4-f4d7-48a3-b667-ccdc27ba29ce req-84b6de92-9a0a-4960-9162-b0ae7d16dfae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038965 May 10 17:20:37.740166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 96/176] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:20:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:20:37.978618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:37.978618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:37.989501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:37.990563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:37.992128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:37.992979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:38.204354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:38.212590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-737629d3-1638-43aa-b022-f68184cc294b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.240773 May 10 17:20:38.213162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 97/177] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:37 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:39.229411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:39.230797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:39.238906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:39.239373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:39.240207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:39.240658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:39.386268 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8d957a26-b387-4093-b57c-5b04afcc3b67 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 14 microversion: 2.20 time: 1.688581 May 10 17:20:39.392144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 81/178] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:37 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 14 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:39.642444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:39.652652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-27053cfd-5ba8-4634-a86f-dfff408084c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.427112 May 10 17:20:39.653229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 98/179] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:39 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:40.399322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:40.400319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:40.408663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:40.409111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:40.409879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:40.410319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:40.670153 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:40.670835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:40.678147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:40.678715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:40.679502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:40.679954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:40.879066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:40.887277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4793b570-9add-468a-a58b-ff9f32f61509 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.221557 May 10 17:20:40.887881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 99/180] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:40 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:41.904079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:41.904684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:41.912010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:41.912466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:41.913247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:41.913694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:42.116352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:42.125218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-37c80fcc-4db0-4a3e-addc-77c68c07897d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.225504 May 10 17:20:42.125786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 100/181] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:41 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:43.141215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:43.141907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:43.149289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:43.149749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:43.150564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:43.151012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:43.345773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:43.354233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2d61e709-a970-409a-ac1b-941d9e530d3f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.216650 May 10 17:20:43.354876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 101/182] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:43 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:43.991265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3c8ab75a-87e7-4011-881b-618c2322c7bd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 14 microversion: 2.20 time: 3.595834 May 10 17:20:43.992046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 82/183] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:40 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 14 bytes in 3598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:44.370803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:44.371434 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:44.378682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:44.379145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:44.379924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:44.380371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:44.581198 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:44.589671 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f316c087-e38c-4d8f-80db-17ac2ae6d2d9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.222564 May 10 17:20:44.590770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 102/184] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:44 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:45.002552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:45.003569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:45.012126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:45.012719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:45.013506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:45.013950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:45.144104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9f8e3e13-1027-4fac-85b9-f962df2f2f2a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 14 microversion: 2.20 time: 0.145778 May 10 17:20:45.144725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 83/185] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:44 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:45.607530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:45.608090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:45.615229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:45.615682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:45.616480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:45.616920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:45.824171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:45.832714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-391704e1-e2a6-4adb-a50c-5f4d95554c6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.229597 May 10 17:20:45.833290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 103/186] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:45 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:46.155895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:46.157140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:46.165565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:46.166034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:46.167018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:46.167498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:46.331568 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ce2c5e1e-6aa5-43cf-a5c1-105539d3cfd5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 14 microversion: 2.20 time: 0.179945 May 10 17:20:46.334695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 84/187] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:46 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:46.848894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:46.850143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:46.858557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:46.859401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:46.860442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:46.861122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:47.131504 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:47.141099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-befc5ba5-331c-4709-8a4b-cba60d2973bd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.295914 May 10 17:20:47.149995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 104/188] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:46 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:47.343474 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:47.344613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:47.352967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:47.353425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:47.354436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:47.354903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:47.519466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4bc88c89-2bf1-49b2-8ec5-3ab571dbe0a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 14 microversion: 2.20 time: 0.180634 May 10 17:20:47.522387 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 85/189] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:47 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:48.159557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:48.160344 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:48.169253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:48.169715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:48.170741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:48.171474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:48.408707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:48.419359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4e4e1523-c0db-4927-8217-ad1c4d496fdb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.264396 May 10 17:20:48.420835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 105/190] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:48 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:48.531513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:48.533061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:48.540853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:48.541525 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:48.542508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:48.543650 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:48.709767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c69d3c8e-5234-4618-bafd-395b8005dd8d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 4572 microversion: 2.20 time: 0.182724 May 10 17:20:48.710796 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 86/191] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:48 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 4572 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:20:49.437352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:49.438172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:49.446184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:49.446743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:49.447590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:49.448124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:49.712495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:49.721978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:49.724018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:49.725575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7130b3c4-7e15-4edf-8b12-e388dee4de35 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.292498 May 10 17:20:49.726994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 106/192] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:49 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:49.734980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:49.734980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:49.734980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:49.734980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:49.924379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8471fa8a-c72b-46e2-a8fc-174383699170 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 10367 microversion: 2.20 time: 0.206588 May 10 17:20:49.928061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 87/193] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:49 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 10367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:20:50.743857 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:50.744483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:50.752628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:50.753094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:50.753887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:50.754406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:50.942200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:50.943561 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:50.955623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:50.956591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:50.958187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:50.958986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:50.968158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:50.978298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3405415f-db7c-499c-abdc-b2c8dec8454b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.238337 May 10 17:20:50.993657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 107/194] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:50 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:51.155996 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b6938b8a-0e4b-417c-8ffe-33f60ab5c181 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 15025 microversion: 2.20 time: 0.221837 May 10 17:20:51.156703 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 88/195] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:50 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 15025 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:20:52.008855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:52.009456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:52.026295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:52.026987 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:52.028289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:52.028737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:52.169097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:52.170106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:52.177920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:52.178405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:52.179188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:52.179828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:52.235679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:52.244615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a41a5aa0-e5d8-4047-99a1-ecf5ee940019 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.239364 May 10 17:20:52.245294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 108/196] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:52 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:52.346425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-57b11b4e-496f-4457-bbda-8bc86fb36839 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 16877 microversion: 2.20 time: 0.181713 May 10 17:20:52.351706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 89/197] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:52 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 16877 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:20:53.262943 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:53.263564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:53.273346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:53.273808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:53.275614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:53.276063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:53.360601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:53.362277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:53.377139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:53.377609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:53.378446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:53.378894 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:53.624784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:53.633370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7909915c-0742-4bdb-8aac-61daf261ce8f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.375790 May 10 17:20:53.634679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 109/198] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:53 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:53.681912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-022798a5-c499-4e38-882d-02a8e650d71f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 17744 microversion: 2.20 time: 0.325381 May 10 17:20:53.683906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 90/199] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:53 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 17744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:20:54.654653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:54.655920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:54.663343 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.663793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:54.664573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.665012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:54.694530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:54.695542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:54.703581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.704220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:54.705305 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.705902 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:54.884053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-206bbbad-196f-4764-b54f-9f46351c3949 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 19127 microversion: 2.20 time: 0.193331 May 10 17:20:54.885652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 91/200] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:54 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 19127 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:20:54.887114 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:54.896160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:54.897065 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:54.897620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-05269b23-f729-440a-99c3-4dcedcb8a2da tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.249043 May 10 17:20:54.898813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 110/201] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:54 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:54.914643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.915249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:54.916105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:54.916609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.002588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:20:55.145467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fc3b10fb-505f-4cf9-b9a3-92289ea1b46a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "DELETE /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 204 len: 0 microversion: 2.1 time: 0.257850 May 10 17:20:55.147943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 92/202] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:20:54 2021] DELETE /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:20:55.156502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:55.157123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:55.165145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.165640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.166469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.166920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.408498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:55.421881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a453daeb-b571-4014-bd64-982a37fdd3b4 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.269559 May 10 17:20:55.422507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 111/203] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:55 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:55.896582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:20:55.897688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:55.905307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.905683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.906495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.906933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.915270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:55.916102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:55.924551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.925201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:55.926331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:55.926977 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:56.161547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:56.170743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-75183bcb-7974-4e27-af96-53da528d8474 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.259321 May 10 17:20:56.171311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 112/204] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:55 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:20:56.439003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:56.439841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:56.447122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:56.447575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:56.448351 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:56.448823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:56.643509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:56.652895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0772696e-3c18-44dc-8d7c-fc22096d18e8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.216988 May 10 17:20:56.653470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 113/205] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:56 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:57.187883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:57.188528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:57.196108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:57.196565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:57.197358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:57.197796 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:57.634228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:57.644888 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9a632aab-e50a-4e19-83b2-3ae915e3f3a6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.461399 May 10 17:20:57.645479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 114/206] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:57 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:57.669855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:57.670220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:57.677320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:57.677779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:57.678634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:57.679079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:58.059528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:58.068464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c65284e7-8451-4bcc-b4de-44c8165e84dd tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.403441 May 10 17:20:58.069043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 115/207] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:57 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:58.662598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:58.663223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:58.670775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:58.671235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:58.672021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:58.672465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:58.931712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:58.941376 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54128390-1bfd-4843-930c-9e2eadcc12cb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.282338 May 10 17:20:58.941968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 116/208] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:58 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:59.086045 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:59.086926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:59.095350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:59.096128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:59.096959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:59.097411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:59.302085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:20:59.310887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-363b22ef-8157-455c-a480-8090d65f4c5a tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.228976 May 10 17:20:59.311472 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 117/209] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:59 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:20:59.769230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-192de534-20ba-4b2f-9eef-5369071a9306 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 23207 microversion: 2.20 time: 3.876606 May 10 17:20:59.773905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 93/210] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:20:55 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 23207 bytes in 3882 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:20:59.960529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:20:59.961154 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:20:59.969511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:59.969511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:20:59.971112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:20:59.971576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:00.180193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:00.188985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8b273295-b090-4345-ad45-6d970cc4a4e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.232173 May 10 17:21:00.189633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 118/211] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:20:59 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:00.329073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:00.329073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:00.337404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:00.338148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:00.339158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:00.339889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:00.552979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:00.561803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a23cb979-bce7-42b8-8f26-8b037f93e3c5 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.237607 May 10 17:21:00.562383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 94/212] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:00 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:00.781270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:00.782311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:00.790081 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:00.790704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:00.791368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:00.791818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:00.992290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-543a403b-d831-4f50-b895-41ec16f03e0a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 25418 microversion: 2.20 time: 0.214784 May 10 17:21:00.997846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 119/213] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:00 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 25418 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:01.208409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:01.209331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:01.217922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:01.218317 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:01.219143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:01.219593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:01.429890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:01.439478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6c7194d6-3e1b-4a08-ad75-0c60edf6c1dc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.237732 May 10 17:21:01.440122 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 95/214] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:01 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:01.580029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:01.580829 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:01.588898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:01.589883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:01.590885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:01.591361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:01.809844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:01.819892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-79a0439a-0840-4ba2-a29d-1fce271c1395 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.244313 May 10 17:21:01.830277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 120/215] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:01 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:02.005640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:02.007048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:02.016163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.017270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.018070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.018936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.218771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c573b187-212b-4101-8807-a6f8f1627e4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 26001 microversion: 2.20 time: 0.217701 May 10 17:21:02.219662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 96/216] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:01 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 26001 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:02.456669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:02.458019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:02.469598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.470153 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.471684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.472209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.838813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:02.839321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:02.847683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.848220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.849353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:02.849860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:02.919974 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:02.928486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0bd59d61-782b-44a5-8bf7-7ac8ee738f4f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.475886 May 10 17:21:02.929159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 121/217] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:02 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:03.231442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:03.232506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:03.240616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:03.241165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:03.242048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:03.242623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:03.365365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:03.382298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9d3fa199-e683-4b47-89ed-1c3a57fd7feb tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1554 microversion: 2.1 time: 0.548653 May 10 17:21:03.382915 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 97/218] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:02 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1554 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:03.422247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ff113b11-515a-4a7d-b3bd-78b429e66174 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 26641 microversion: 2.20 time: 0.195150 May 10 17:21:03.423279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 122/219] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:03 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 26641 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:03.606231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-c9e61e4c-9dc5-487b-9826-2e2f9f1f46f2 req-6b312857-82f0-4915-a234-99081176b6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92dbb526-fe62-4eea-a99c-fb8105f3438c", "name": "network-vif-deleted", "tag": "eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:03.608126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:21:03.608126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:21:03.617111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c9e61e4c-9dc5-487b-9826-2e2f9f1f46f2 req-6b312857-82f0-4915-a234-99081176b6c4 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:03.617583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c9e61e4c-9dc5-487b-9826-2e2f9f1f46f2 req-6b312857-82f0-4915-a234-99081176b6c4 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:03.636763 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-c9e61e4c-9dc5-487b-9826-2e2f9f1f46f2 req-6b312857-82f0-4915-a234-99081176b6c4 service nova] Creating event network-vif-deleted:eae3a54d-4bdf-42bf-b2c1-23c6c7f8a5a4 for instance 92dbb526-fe62-4eea-a99c-fb8105f3438c on hv-cinder-78638 May 10 17:21:03.641715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-c9e61e4c-9dc5-487b-9826-2e2f9f1f46f2 req-6b312857-82f0-4915-a234-99081176b6c4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039291 May 10 17:21:03.642234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 98/220] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:21:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:21:03.946619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:03.947336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:03.956073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:03.956678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:03.957466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:03.957915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:04.173396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:04.182029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-38b4363c-e2e2-4740-826d-7465b5fd2952 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.240113 May 10 17:21:04.182640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 123/221] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:03 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:04.400951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:04.402294 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:04.409955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:04.410446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:04.411239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:04.411679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:04.435011 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:04.435942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:04.444053 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:04.444575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:04.445637 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:04.446233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:04.581547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '230362c6442546df82f2a31e48dc0d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad2c46a2acb4b4d94726b9d4662b49d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:04.591057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-714fc3b9-ae35-4a38-ba2d-ea3fbbb53857 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 200 len: 1345 microversion: 2.1 time: 0.194878 May 10 17:21:04.591631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 99/222] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:04 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 1345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:04.677911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2aefdf20-5bf0-4690-a8b8-6ac805012ee7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27110 microversion: 2.20 time: 0.246785 May 10 17:21:04.678766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 124/223] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:04 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27110 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:05.199639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:05.200396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:05.207776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.208524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:05.209545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.210208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:05.451485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:05.459827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e995cb7e-bae1-4e2c-89c1-56608966f3eb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.264416 May 10 17:21:05.460389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 100/224] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:05 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:05.609161 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:05.609994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:05.618258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.618762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:05.619560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.620014 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:05.671735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] HTTP exception thrown: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. May 10 17:21:05.672337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Returning 404 to user: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:21:05.673197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7a58c125-101b-41c4-b298-09f799f338e3 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 404 len: 111 microversion: 2.1 time: 0.068803 May 10 17:21:05.673757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 125/225] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:05 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:21:05.690137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:05.691111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:05.698636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.699100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:05.699907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:05.700359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:06.185359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-342b5cc7-cc95-4282-8ff1-3654307d1c7e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27623 microversion: 2.20 time: 0.498877 May 10 17:21:06.186121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 101/226] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:05 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27623 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:06.480887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:06.482264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:06.493017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:06.493471 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:06.494270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:06.494736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:06.701785 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:06.710406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7f02b764-2cee-4298-81c9-7f661c9447d2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.237258 May 10 17:21:06.710916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 126/227] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:06 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:07.197633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:07.199395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:07.213225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:07.213686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:07.214517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:07.218113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:07.728237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:07.728717 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:07.737081 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:07.737535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:07.738321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:07.738794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:07.944217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:07.952401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1c2f86a4-02be-4ef4-8768-a59201c396ef tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.229032 May 10 17:21:07.952969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 127/228] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:07 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:08.970173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:08.970890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:08.982663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:08.983372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:08.984229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:08.984673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:09.190628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:09.199892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2334bbd5-2469-4b89-93db-4a07a7eaea23 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.233457 May 10 17:21:09.200535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 128/229] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:08 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:10.217751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:10.218446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:10.225960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:10.226441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:10.227228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:10.227665 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:10.439805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:10.452232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b3e6615d-5750-464a-a3c7-3bf832b9caeb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.239217 May 10 17:21:10.453218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 129/230] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:10 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:11.469119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:11.469733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:11.477529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:11.477996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:11.478803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:11.479245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:11.694204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:11.702963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6a9f4977-4119-450f-817f-db2a169ac6cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.237492 May 10 17:21:11.703712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 130/231] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:11 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:12.720849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:12.722124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:12.730105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:12.730795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:12.731787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:12.732233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:12.967510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:12.976820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-557af2e1-7603-448e-8179-31f736d8ce6c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.260621 May 10 17:21:12.977470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 131/232] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:12 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:13.995074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:13.997407 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:14.006449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:14.007087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:14.008214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:14.008811 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:14.210273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:14.218998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-74110c47-15d8-4592-80e4-161a56e3a003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.228040 May 10 17:21:14.219570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 132/233] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:13 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:15.236161 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:15.236759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:15.244035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:15.244486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:15.245259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:15.245701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:15.379190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-25d97902-6206-4fe5-8875-68eb2d44e1b1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27806 microversion: 2.20 time: 8.185478 May 10 17:21:15.380096 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 102/234] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:07 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27806 bytes in 8187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:15.569338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:15.577472 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-08ed0849-d6c1-43a2-a03d-6f419d945093 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.345013 May 10 17:21:15.578047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 133/235] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:15 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:16.391987 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:16.392984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:16.400971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:16.401451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:16.402224 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:16.402690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:16.593128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:16.593743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:16.601599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:16.602050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:16.602847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:16.603290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:16.665173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a170eab8-dcd0-4fef-92e9-82cc7f447142 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27806 microversion: 2.20 time: 0.277170 May 10 17:21:16.666118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 103/236] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:16 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27806 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:16.830942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:16.845941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-69764f6e-d6e0-4d83-b92e-84443dd3079f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.256346 May 10 17:21:16.846541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 134/237] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:16 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:17.170977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-998139632", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "0cfd4b2e-df56-43d0-908b-ea446d61e6b9"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:17.677304 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:17.678267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:17.685675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:17.686134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:17.686952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:17.687398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:23.757681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2b83b004-fba7-467f-9c3d-2b4896e543fd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27933 microversion: 2.20 time: 6.084092 May 10 17:21:23.758602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 135/238] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:17 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27933 bytes in 6086 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:23.764198 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:23.764907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:23.772968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:23.773431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:23.774215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:23.774688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:23.978577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:23.987724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-df7f4518-db40-4ac9-bf4b-fc0c135391e1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.227753 May 10 17:21:23.988510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 136/239] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:23 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:24.001249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:24.001749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:24.008921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.009473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:24.010266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.010759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:24.063741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] HTTP exception thrown: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. May 10 17:21:24.064326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Returning 404 to user: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:21:24.065169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1193cc6b-f336-4b33-b19c-0e65865e48c8 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "DELETE /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 404 len: 111 microversion: 2.1 time: 0.067439 May 10 17:21:24.065735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 137/240] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:21:23 2021] DELETE /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:21:24.073249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:24.073860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] [instance: 92dbb526-fe62-4eea-a99c-fb8105f3438c] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:24.081083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.081537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:24.082306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.082774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:24.133288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] HTTP exception thrown: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. May 10 17:21:24.133891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] Returning 404 to user: Instance 92dbb526-fe62-4eea-a99c-fb8105f3438c could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:21:24.134756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-031904a5-5ce2-4dfd-8438-fce583ed4308 tempest-DeleteServersTestJSON-1012294866 tempest-DeleteServersTestJSON-1012294866-project] 10.222.0.32 "GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c" status: 404 len: 111 microversion: 2.1 time: 0.064929 May 10 17:21:24.135318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 138/241] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:24 2021] GET /compute/v2.1/servers/92dbb526-fe62-4eea-a99c-fb8105f3438c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:21:24.769244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:24.770249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:24.779106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.779567 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:24.780369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:24.780818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:25.298844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f92d9007-0af5-4b07-bb3c-5703d5bbf4bf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 27933 microversion: 2.20 time: 0.532961 May 10 17:21:25.299395 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 139/242] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:24 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 27933 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:25.304547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:25.305278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:25.313460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:25.313925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:25.314739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:25.315186 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:25.529586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:25.538317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-df93ecff-ef8c-426e-ab95-bf605d2c8efd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.237427 May 10 17:21:25.538990 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 140/243] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:25 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:26.313362 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:26.314396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:26.322839 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:26.323854 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:26.325789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:26.326641 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:26.500202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-897be71f-47a3-4c35-ad6d-f74b601edd32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28051 microversion: 2.20 time: 0.190362 May 10 17:21:26.504281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 141/244] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:26 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28051 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:26.571565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:26.572462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:26.586095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:26.587607 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:26.588452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:26.589852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:26.800382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:26.808671 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ba4d79c1-7616-4f8f-876d-a57de7d86840 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.242858 May 10 17:21:26.809500 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 142/245] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:26 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:27.520820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:27.520820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:27.524335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:27.524795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:27.525603 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:27.526050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:27.689579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-42acb216-2523-4883-b1d8-85a8b5a97ec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.180767 May 10 17:21:27.690883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 143/246] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:27 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:27.828106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:27.828955 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:27.839118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:27.839826 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:27.840763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:27.841537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:28.125602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:28.138449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-85629917-5a10-4102-9181-5822457ef311 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.315953 May 10 17:21:28.139032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 144/247] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:27 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:28.703181 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:28.704362 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:28.712499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:28.712871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:28.714582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:28.715040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:28.851448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-38d21f3e-9cdf-49b0-8727-ee8630ad6ae8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.152030 May 10 17:21:28.855789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 145/248] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:28 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:29.156105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:29.156986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:29.166206 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:29.166953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:29.167985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:29.168530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:29.411763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:29.420487 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4382874c-23bb-43eb-851e-636bf54aff63 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.268846 May 10 17:21:29.421058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 146/249] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:29 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:29.863539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:29.864460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:29.872480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:29.872976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:29.873767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:29.874219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:30.032009 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0afae186-9737-40f9-95c6-ca528d782dea tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.171949 May 10 17:21:30.032757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 147/250] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:29 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:30.439166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:30.440123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:30.449552 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:30.450023 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:30.450856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:30.451406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:30.599549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] validate_networks() for [('0cfd4b2e-df56-43d0-908b-ea446d61e6b9', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:21:30.850655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:30.859782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dcff5ce2-dcac-45f5-9342-83786b704b97 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.425341 May 10 17:21:30.860656 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 148/251] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:30 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:31.044335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:31.046055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:31.061421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.062696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:31.066109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.067061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:31.305501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:21:31.305932 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:21:31.306442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:21:31.306864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:21:31.307868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:21:31.316416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.316878 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:31.317696 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.318139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:31.335281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:21:31.339267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for user a32fb4db0ebb499a9cf1103e888cbbc6 and project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:21:31.350253 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:21:31.352714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:21:31.396370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cfa5f9e4-b54b-4313-8ec8-cf194b935f09 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.230098 May 10 17:21:31.397166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 104/252] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:21:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 14232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:21:31.407021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e16c2a2c-7c63-4c13-84a5-8e692e4d87a1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:31.407741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e16c2a2c-7c63-4c13-84a5-8e692e4d87a1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:31.482866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e16c2a2c-7c63-4c13-84a5-8e692e4d87a1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:31.490940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e16c2a2c-7c63-4c13-84a5-8e692e4d87a1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1217 microversion: 2.1 time: 0.087530 May 10 17:21:31.491503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 105/253] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:31 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:31.515320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-34faad7e-d2f4-4573-8897-d4712ccbb303 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.475092 May 10 17:21:31.517363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 149/254] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:31 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:31.876871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:31.877523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:31.885124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.885526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:31.886303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:31.886773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:32.080091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:32.088251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d9b4407d-ace4-4aa6-a768-7d7d6af87379 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.215166 May 10 17:21:32.088823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 106/255] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:31 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:32.507505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:32.508299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:32.516728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:32.517180 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:32.517957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:32.518441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:32.527931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:32.528911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:32.536449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:32.536915 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:32.537698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:32.538142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:32.635825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:32.644118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f13cc129-3f5a-4b97-a6e8-c41eb74c7e2d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1221 microversion: 2.1 time: 0.140727 May 10 17:21:32.644687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 150/256] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:32 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:33.105288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:33.105911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:33.113254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:33.113706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:33.114509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:33.114953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:33.310493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:33.318866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9ae0f5c5-c033-4c02-8ea0-f357e789ebf5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.217316 May 10 17:21:33.319430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 151/257] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:33 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:33.660821 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:33.661437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:33.669787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:33.670241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:33.671059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:33.671503 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:33.781525 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:33.789733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-85ebed0c-0921-48aa-9796-714da76a8f74 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1221 microversion: 2.1 time: 0.132716 May 10 17:21:33.790301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 152/258] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:33 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:34.335267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:34.335827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:34.343687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:34.344145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:34.344923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:34.345368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:34.686247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:34.694374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-afe8e435-090d-4246-ba7c-eb9ef4e9c4d5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.362828 May 10 17:21:34.694946 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 153/259] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:34 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:34.806503 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:34.807249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:34.815026 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:34.815481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:34.816250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:34.816690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:34.925560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:34.934696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8134de43-752d-41b7-8989-ea8fbf3b5622 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1221 microversion: 2.1 time: 0.131792 May 10 17:21:34.935267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 154/260] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:34 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:35.712135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:35.712705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:35.721010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:35.721468 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:35.722245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:35.722726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:35.916510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:35.924818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2c6eec38-34b2-4853-bb8a-2a0b186e2964 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.216437 May 10 17:21:35.925467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 155/261] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:35 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:35.951485 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:35.952102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:35.959273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:35.959725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:35.960499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:35.960939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:36.067984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-71e0854a-9d3f-486c-a9da-89c34ed65f0f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 3.543205 May 10 17:21:36.069234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 107/262] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:32 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 3546 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:36.079802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:36.088356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-235b26bb-f39d-4564-aaf9-399866058e9a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1221 microversion: 2.1 time: 0.140732 May 10 17:21:36.092996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 156/263] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:35 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:36.944314 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:36.945351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:36.954656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:36.955118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:36.955908 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:36.956356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:37.082124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:37.083095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:37.091038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:37.091501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:37.092388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:37.093046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:37.252778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eeb4f439-1915-4780-a0cc-321c01e8197f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.175061 May 10 17:21:37.254203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 157/264] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:37 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:37.261189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:37.261919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:37.270003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:37.270511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:37.271313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:37.271765 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:37.285840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:37.294788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fad36e02-08fb-47df-ac7a-6fb081cd92b0 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.356112 May 10 17:21:37.295466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 108/265] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:36 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:37.431618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:37.441260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-65114229-346d-46aa-86a8-2f9ea27ec5b6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1275 microversion: 2.1 time: 0.185158 May 10 17:21:37.441843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 158/266] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:37 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:38.266287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:38.267740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:38.279403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.286605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.287737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.288256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.312122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:38.312746 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:38.326541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.328419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.329248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.329702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.433047 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-370506d3-08b6-44f7-98eb-5996ba364fcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.170264 May 10 17:21:38.434613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 109/267] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:38 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:38.462980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:38.464864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:38.475191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.475998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.476947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:38.477620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:38.829954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:38.839572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-919d29d9-f783-414f-8930-66c8aaeb19db tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.531075 May 10 17:21:38.846089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 159/268] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:38 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:39.024076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:39.036900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-68c65e1f-b2e1-489a-9625-cda05e967d7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.579928 May 10 17:21:39.037799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 110/269] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:38 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:39.445896 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:39.446964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:39.456057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:39.456542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:39.457328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:39.457767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:39.467076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-fc71b552-30d8-48b4-834b-38e783d2d8f5 req-bafd092d-3b4d-4b69-bded-2670f242366a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df73bdaf-ec61-4dda-bc79-06dd29d537ee", "tag": "63230674-0039-4b7c-80d1-e8ccab7f7656"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:39.469505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:21:39.469505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:21:39.480940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fc71b552-30d8-48b4-834b-38e783d2d8f5 req-bafd092d-3b4d-4b69-bded-2670f242366a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:39.481675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fc71b552-30d8-48b4-834b-38e783d2d8f5 req-bafd092d-3b4d-4b69-bded-2670f242366a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:39.500556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-fc71b552-30d8-48b4-834b-38e783d2d8f5 req-bafd092d-3b4d-4b69-bded-2670f242366a service nova] Creating event network-changed:63230674-0039-4b7c-80d1-e8ccab7f7656 for instance df73bdaf-ec61-4dda-bc79-06dd29d537ee on hv-cinder-78638 May 10 17:21:39.506069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-fc71b552-30d8-48b4-834b-38e783d2d8f5 req-bafd092d-3b4d-4b69-bded-2670f242366a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045333 May 10 17:21:39.506702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 111/270] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:21:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:21:39.626421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ac2ef82d-436b-4091-858d-76c6a82ce0aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.184739 May 10 17:21:39.630869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 160/271] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:39 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:39.857390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:39.858111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:39.865506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:39.865960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:39.866958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:39.867409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:40.053664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:40.054385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:40.062505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:40.062945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:40.063736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:40.064176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:40.310203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:40.319024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1241293e-83a2-4356-b287-700f8a9a280d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1521 microversion: 2.1 time: 0.466379 May 10 17:21:40.319701 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 112/272] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:39 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:40.404683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:40.412879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6ca5594d-0a3b-4f3a-b14e-0ceb19ea8eb3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.363503 May 10 17:21:40.413655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 161/273] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:40 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:40.640818 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:40.641898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:40.650655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:40.651161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:40.651936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:40.652382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.120409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-313d1b0b-6d50-4092-a859-f7446d246a0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.484364 May 10 17:21:41.121285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 113/274] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:40 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:41.336644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:41.337553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:41.349038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.349038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.349038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.349038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.431523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:41.432775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:41.441315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.441315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.442117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.442867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.692338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:41.701461 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-214c31c6-17f1-41a4-be78-ae6310352978 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1501 microversion: 2.1 time: 0.368865 May 10 17:21:41.702045 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 162/275] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:41 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:41.717288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:41.717904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:41.725942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.726615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.727445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:41.727909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:41.767378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:41.775829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e5d96f0a-c09f-4d60-b8e3-d4bc93e5e0d8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.348985 May 10 17:21:41.776409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 114/276] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:41 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:41.929723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:41.938098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f5c9b1d8-853e-49f0-926a-3b433e37f4f3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1515 microversion: 2.1 time: 0.224459 May 10 17:21:41.938638 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 163/277] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:41 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1515 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:42.131715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:42.132779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:42.140730 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:42.141272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:42.142089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:42.142811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:42.329804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9b9e643b-7046-4373-a5c4-d017a332fee8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.201869 May 10 17:21:42.331036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 115/278] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:42 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:42.793112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:42.793745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:42.801543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:42.801996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:42.802852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:42.803299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:43.009850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:43.018370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0052bd20-e99c-4e4c-93de-7d7b5bd88074 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.229681 May 10 17:21:43.018959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 164/279] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:42 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:43.342212 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:43.343850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:43.353211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:43.353671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:43.354994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:43.355441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:43.497490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-edaa8ee7-44df-41b8-af47-b01244ab2234 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.158928 May 10 17:21:43.501926 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 116/280] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:43 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:44.035865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:44.036639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:44.045481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.046065 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.047100 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.047656 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.266718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:44.276254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-43097d53-6d7f-4c60-818a-0c12b0bf4986 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.245052 May 10 17:21:44.277043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 165/281] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:44 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:44.510286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:44.511379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:44.539038 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.546201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.547243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.548069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.628803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:44.629952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:44.640936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.641941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.643326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.643992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.712745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'flavor' on Instance uuid 568c5267-2f2c-4d3b-8364-a05c2b8192b1 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:21:44.826253 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c5095a75-d609-403c-b588-3c3927fc82b4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.319794 May 10 17:21:44.828087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 117/282] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:44 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:44.879730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2a212c8c-3f74-4c1e-962d-22c89af68844 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action" status: 200 len: 32 microversion: 2.1 time: 0.257139 May 10 17:21:44.880356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 166/283] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:21:44 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:21:44.889937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:44.890800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:44.898843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.899772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:44.901448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:44.902053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:45.296757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:45.297482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:45.309572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:45.310048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:45.310882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:45.311335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:45.350966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:45.362025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-80349df5-471b-4693-9339-b632606324ec tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.476161 May 10 17:21:45.368287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 118/284] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:44 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:45.816257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:45.827806 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-80da2318-1efd-4d0d-a67f-d5166aa9af32 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.535385 May 10 17:21:45.828390 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 167/285] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:45 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:45.838294 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:45.839837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:45.857355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:45.858050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:45.859363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:45.860476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:46.046200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8772997a-5747-444b-acdc-9d31fd2f57b2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.211147 May 10 17:21:46.051471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 119/286] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:45 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:46.381250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:46.381870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:46.391614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:46.392146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:46.392976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:46.393579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:46.678886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:46.688152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a0650096-0f15-4d63-9220-06449abe81c1 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.312523 May 10 17:21:46.689084 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 168/287] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:46 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:46.849407 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:46.850857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:46.861270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:46.861925 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:46.862928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:46.863547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:47.058952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:47.059881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:47.070689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:47.071156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:47.071963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:47.072396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:47.225286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:47.240220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c6cf375d-ec5a-46d3-87fc-b7bcd004b990 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.397763 May 10 17:21:47.241322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 120/288] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:46 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:47.251131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2de13666-c73d-4d82-952a-2504344b50d0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.196140 May 10 17:21:47.251750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 169/289] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:47 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:47.704894 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:47.705904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:47.713625 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:47.714426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:47.715430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:47.716082 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.061231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:48.082880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4a1888d0-fd0a-4e62-9bbd-6659565e98bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.380405 May 10 17:21:48.085343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 121/290] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:47 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:48.267299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:48.271684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:48.273880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:48.276547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:48.286061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:48.286851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.287951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:48.288716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.290236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:48.290725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.292055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:48.292516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.461724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6ad980c4-abb2-4107-a001-f672cf231b4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.201868 May 10 17:21:48.463114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 122/291] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:48 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:48.524080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-d2fc5160-b60d-4454-b5f9-5d08c43c6164 req-ad57f2ee-5026-4fd7-88db-326ab97ac5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df73bdaf-ec61-4dda-bc79-06dd29d537ee", "name": "network-vif-plugged", "status": "completed", "tag": "63230674-0039-4b7c-80d1-e8ccab7f7656"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:48.526718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:21:48.526718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:21:48.537942 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d2fc5160-b60d-4454-b5f9-5d08c43c6164 req-ad57f2ee-5026-4fd7-88db-326ab97ac5b2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:48.538973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d2fc5160-b60d-4454-b5f9-5d08c43c6164 req-ad57f2ee-5026-4fd7-88db-326ab97ac5b2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:48.589268 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-d2fc5160-b60d-4454-b5f9-5d08c43c6164 req-ad57f2ee-5026-4fd7-88db-326ab97ac5b2 service nova] Creating event network-vif-plugged:63230674-0039-4b7c-80d1-e8ccab7f7656 for instance df73bdaf-ec61-4dda-bc79-06dd29d537ee on hv-cinder-78638 May 10 17:21:48.594843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-d2fc5160-b60d-4454-b5f9-5d08c43c6164 req-ad57f2ee-5026-4fd7-88db-326ab97ac5b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076528 May 10 17:21:48.596014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 123/292] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:21:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:21:48.738272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:48.753333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3d840350-3278-4999-8784-85a1aee4a562 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.497548 May 10 17:21:48.762930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 170/293] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:48 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:49.101709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:49.102640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:49.110026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.110559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.111344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.111788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.380975 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:49.390248 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-12ba9477-1791-4526-b114-0c1421554f53 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.292938 May 10 17:21:49.399830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 124/294] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:49 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:49.482931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:49.484528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:49.493332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.493882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.495352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.496661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.770649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:49.771208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:49.779052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.779509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.780290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:49.780728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:49.856297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aa9ede91-295a-4f66-bce9-e299ccc1dc55 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.377692 May 10 17:21:49.857176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 171/295] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:49 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:50.024342 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:50.033245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-346e181d-9284-41dc-be29-4474e74316df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.266512 May 10 17:21:50.033811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 125/296] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:49 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:50.407574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:50.408313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:50.416170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:50.416629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:50.417410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:50.417853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:50.621292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:50.629933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-df9c5f71-da69-4e57-b1ae-23419c7d0f8b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.226512 May 10 17:21:50.630545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 172/297] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:50 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:50.732362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-401080837", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:50.797147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] validate_networks() for None {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:21:50.868176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:50.869183 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:50.877113 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:50.877569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:50.878362 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:50.878812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.029962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fa9f255d-98e7-492b-9898-7c117ae71992 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.165311 May 10 17:21:51.030653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 173/298] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:50 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:51.052431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:51.053057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:51.063558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.064103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.065145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.065760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.079762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:21:51.080210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:21:51.080698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:21:51.081110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:21:51.081714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:21:51.091254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.091774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.092655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.093100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.114286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Getting quotas for project c903c1d087f2488ca43f869d75ba30d9. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:21:51.118293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Getting quotas for user 5bf64a132c244c5c85aaf84a3ecfa686 and project c903c1d087f2488ca43f869d75ba30d9. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:21:51.128985 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:21:51.131357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:21:51.181439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-49a50082-c8c1-4b70-b9ac-2a98fe102040 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453309 May 10 17:21:51.182889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 126/299] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:21:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:21:51.193102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5db2841b-0535-4802-acc1-ec5da63e20ac tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:51.194123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5db2841b-0535-4802-acc1-ec5da63e20ac tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:51.295265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5db2841b-0535-4802-acc1-ec5da63e20ac tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:51.302963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5db2841b-0535-4802-acc1-ec5da63e20ac tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1214 microversion: 2.1 time: 0.114429 May 10 17:21:51.303683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 127/300] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:51 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:51.322827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:51.331445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f7981a9a-a54e-4d58-bd9b-0bfae6ceb68f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1317 microversion: 2.1 time: 0.283115 May 10 17:21:51.332018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 174/301] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:51 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:51.648637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:51.651195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:51.660393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.660865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.661655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:51.662335 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:51.892413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:51.903551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-566202af-86a3-4f26-9008-a7ecd748499c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.259305 May 10 17:21:51.906654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 128/302] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:51 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:52.041782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:52.042835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:52.060165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.060752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:52.061732 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.062178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:52.206078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1c367a87-bbc7-4c13-8d40-910833d17cfb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.168166 May 10 17:21:52.206763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 175/303] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:52 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:52.253940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1263600703", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "59c79b3a-606f-480a-bc59-da16504e6cb0"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:52.320225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] validate_networks() for [('59c79b3a-606f-480a-bc59-da16504e6cb0', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:21:52.320550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:52.321264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:52.331134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.331737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:52.332738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.333383 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:52.495794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:52.514850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6e88f33a-1414-4a8f-a055-d90cadebd9e0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1266 microversion: 2.1 time: 0.198477 May 10 17:21:52.515752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 176/304] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:52 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:21:52.520221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:52.521157 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:52.531810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.532587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:52.533644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:52.534305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.210073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:53.221670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e1e8a85c-78f0-4a03-84da-ebb3ab603152 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1507 microversion: 2.1 time: 0.704876 May 10 17:21:53.233772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 177/305] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:52 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1507 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:53.233772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:53.233772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:53.235993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.236773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.237399 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.237917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.513381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:21:53.514094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:21:53.516639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:21:53.517350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:21:53.518570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:21:53.534539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.535223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.536322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.536956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.597513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Getting quotas for project 0c9cc9feff17427b9609bc260703b774. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:21:53.607780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Getting quotas for user 34a86cc6459b424f8e6dc8b08e7dc5f0 and project 0c9cc9feff17427b9609bc260703b774. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:21:53.635324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:21:53.637535 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:21:53.645215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:53.653895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8a4d9d39-c24a-4c75-a6d3-2b1f792355b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.430336 May 10 17:21:53.654585 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 178/306] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:53 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:53.659330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:53.660644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:53.669089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.669610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.670564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.671150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.701528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-39d84768-ecba-4230-a8c6-5a13f7a458bf tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.451248 May 10 17:21:53.702924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 129/307] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:21:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:21:53.708256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95af3424-b52b-4c5a-be0b-dabffa3049f8"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:53.710487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:53.719385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.720104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.721589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.722500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.814378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1d83fa9f-2540-48f2-ad64-efaf1a50ec4a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.158053 May 10 17:21:53.815420 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 179/308] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:53 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:53.824945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:53.826079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:53.844642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.846211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.848489 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:53.850759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:53.968736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Invalid volume: volume 95af3424-b52b-4c5a-be0b-dabffa3049f8 is already attached to instances: b022bb70-cca1-48d9-98cc-c4f53580a1b9 May 10 17:21:53.969941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 400 to user: Invalid volume: volume 95af3424-b52b-4c5a-be0b-dabffa3049f8 is already attached to instances: b022bb70-cca1-48d9-98cc-c4f53580a1b9 {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:21:53.971023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3de5bc95-7849-4eb5-bc28-cf1f4db6b1cb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.266908 May 10 17:21:53.976988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 130/309] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:21:53 2021] POST /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee/os-volume_attachments => generated 174 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:21:53.986473 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e26b8ba0-aa07-463c-bb13-1a4a883d01db tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:53.993954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e26b8ba0-aa07-463c-bb13-1a4a883d01db tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:54.083057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:54.097875 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-64ee8994-edb0-485c-a553-bf3fc71ba3cf tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1272 microversion: 2.1 time: 0.280910 May 10 17:21:54.098580 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 180/310] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:53 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:54.133703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:54.134218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:54.149187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.149662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:54.151016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.151468 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:54.201889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e26b8ba0-aa07-463c-bb13-1a4a883d01db tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:54.214249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e26b8ba0-aa07-463c-bb13-1a4a883d01db tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1219 microversion: 2.1 time: 0.231375 May 10 17:21:54.216710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 131/311] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:53 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:54.382236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'services' on Instance uuid b022bb70-cca1-48d9-98cc-c4f53580a1b9 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:21:54.532516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-53c84275-5618-4189-803f-c338bf684a11 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9/os-volume_attachments/95af3424-b52b-4c5a-be0b-dabffa3049f8" status: 202 len: 0 microversion: 2.1 time: 0.401828 May 10 17:21:54.536454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 181/312] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:21:54 2021] DELETE /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9/os-volume_attachments/95af3424-b52b-4c5a-be0b-dabffa3049f8 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:54.676396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:54.679952 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:54.707833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.724935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:54.724935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.724935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:54.829845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:54.831185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:54.848712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.850679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:54.853365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:54.854932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:55.110694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-db254c1c-5722-4770-a8fe-cc5416551af0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.286036 May 10 17:21:55.114584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 182/313] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:54 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:21:55.117752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:55.127377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:55.147541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:55.148023 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:55.148930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:55.149386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:55.559542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:55.577371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5847e274-3ebc-4a91-9d5c-b9a28f160003 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.909049 May 10 17:21:55.579100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 132/314] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:54 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:55.584720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:55.585652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:55.604707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:55.605183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:55.606056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:55.606536 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:55.786136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:55.799586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8d6962cd-41a5-4680-9c2b-08fe402ed369 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1271 microversion: 2.1 time: 0.219155 May 10 17:21:55.800340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 133/315] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:55 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:55.850832 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:55.865690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-af3a946f-41b9-49e1-a1c6-73ec7a60f1e3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.752188 May 10 17:21:55.866421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 183/316] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:55 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:56.123107 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:56.124150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:56.134316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.135264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.136298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.137048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.343941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-83111f5f-9704-4fb2-b04c-3e3175441a6e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.224473 May 10 17:21:56.345829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 134/317] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:56 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:56.405497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-b7e25a49-ae05-47ec-b024-774b3f138c96 req-8c7382c3-c0c8-4507-97b9-eda3091328f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d277ca7-6c54-4455-abee-1158e0b2ac22", "tag": "d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:56.407490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:21:56.407490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:21:56.423282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b7e25a49-ae05-47ec-b024-774b3f138c96 req-8c7382c3-c0c8-4507-97b9-eda3091328f6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.423831 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b7e25a49-ae05-47ec-b024-774b3f138c96 req-8c7382c3-c0c8-4507-97b9-eda3091328f6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.442549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-b7e25a49-ae05-47ec-b024-774b3f138c96 req-8c7382c3-c0c8-4507-97b9-eda3091328f6 service nova] Creating event network-changed:d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc for instance 0d277ca7-6c54-4455-abee-1158e0b2ac22 on hv-cinder-78638 May 10 17:21:56.448600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-b7e25a49-ae05-47ec-b024-774b3f138c96 req-8c7382c3-c0c8-4507-97b9-eda3091328f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 May 10 17:21:56.449517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 184/318] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:21:56.596754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:56.602539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:56.618533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.622533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.623500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.624204 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.818016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:56.819100 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:56.829013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.829737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.830935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.831531 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.925461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:56.938751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-12edd563-783a-471c-abeb-2d325f0a8d68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.346065 May 10 17:21:56.940155 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 135/319] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:56 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:56.945364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:56.946233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:56.955427 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.956120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:56.957967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:56.958659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:57.516543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:57.522664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:57.530384 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-97e8a6e2-7fbb-4431-a145-2bcd7af9c981 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.716790 May 10 17:21:57.531118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 185/320] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:56 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:57.536752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2006778913", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "0cfd4b2e-df56-43d0-908b-ea446d61e6b9"}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:57.537337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f8b568bf-9b1e-4345-89cc-d06ef4d4c92b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.595587 May 10 17:21:57.547837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 136/321] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:56 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:57.553411 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:57.554590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:57.563444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:57.564023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:57.576607 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:57.577149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:57.619235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] validate_networks() for [('0cfd4b2e-df56-43d0-908b-ea446d61e6b9', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:21:57.957678 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-641f6c4c-2730-4ec9-b2f4-fd5fa9e77835 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28168 microversion: 2.20 time: 0.408036 May 10 17:21:57.961510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 137/322] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:21:57 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28168 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:21:57.966219 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-d593cd95-c214-46c9-b308-3863d41a757b req-8600dd1e-53da-4505-b7cc-8f42b1d731c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e932c1fd-4400-4eee-87e0-653b3de9b593", "tag": "e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:57.968283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:21:57.968283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:21:57.977862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d593cd95-c214-46c9-b308-3863d41a757b req-8600dd1e-53da-4505-b7cc-8f42b1d731c9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:57.978320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d593cd95-c214-46c9-b308-3863d41a757b req-8600dd1e-53da-4505-b7cc-8f42b1d731c9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.040097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-d593cd95-c214-46c9-b308-3863d41a757b req-8600dd1e-53da-4505-b7cc-8f42b1d731c9 service nova] Creating event network-changed:e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6 for instance e932c1fd-4400-4eee-87e0-653b3de9b593 on hv-cinder-78638 May 10 17:21:58.053490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-d593cd95-c214-46c9-b308-3863d41a757b req-8600dd1e-53da-4505-b7cc-8f42b1d731c9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093139 May 10 17:21:58.059186 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 138/323] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:21:58.065638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:58.066549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:58.078648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.078648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.078648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.078648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.649360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:58.665620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:21:58.666236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:21:58.666600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:21:58.667018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:21:58.667464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:21:58.667573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bdf6ece4-0519-433d-aeef-d4931147119c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.607007 May 10 17:21:58.668278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 139/324] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:58 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:58.673312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-979821783", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "247b7704-949d-47ff-a7d6-c3dc7a6e8e45"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:21:58.683411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.683875 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.684782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.685337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.704098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:21:58.707846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for user a32fb4db0ebb499a9cf1103e888cbbc6 and project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:21:58.719230 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:21:58.722124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:21:58.758577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] validate_networks() for [('247b7704-949d-47ff-a7d6-c3dc7a6e8e45', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:21:58.779959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-60ff5a14-fff5-4a9d-90be-59f4f5f95a2c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247351 May 10 17:21:58.780711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 186/325] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:21:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:21:58.786897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:58.787890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:58.797551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.798666 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:58.799776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:58.800477 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:59.612259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:21:59.621796 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b9e6bc57-30af-420b-9ed6-23eb95ccae0b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.839618 May 10 17:21:59.631627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 187/326] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:58 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:21:59.638564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:21:59.639540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:21:59.647359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:59.647812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:59.648716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:59.649157 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:59.932542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:21:59.933755 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:21:59.934461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:21:59.935135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:21:59.935873 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:21:59.947061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:59.948267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:59.949771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:21:59.950433 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:21:59.998257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Getting quotas for project 74edb2011cde4bfcb01eceaf97474332. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:22:00.001069 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:00.010642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-801ae216-8626-48b5-9f9d-e46059a70fef tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.377619 May 10 17:22:00.011716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 188/327] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:21:59 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:00.013497 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Getting quotas for user e39c8835b96944e780c5b462d7c93a8d and project 74edb2011cde4bfcb01eceaf97474332. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:22:00.016469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:00.017281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:00.025396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.026225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.027193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.027788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.035767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:22:00.038587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:22:00.096686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b092647a-e54e-4774-a425-9af0fd2093ff tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427037 May 10 17:22:00.098245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 140/328] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:21:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:22:00.103758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:00.104948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:00.113000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.113839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.114808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.115401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.175778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:00.187928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d4fd5165-e419-4844-adc5-50593de493ef tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1270 microversion: 2.1 time: 0.174996 May 10 17:22:00.188557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 189/329] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:00 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:00.201379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:00.202024 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:00.209682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.210201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.211075 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.211524 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.454773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:00.464410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c0559168-4c5d-4b8d-b924-3ff4b0df97c2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.274824 May 10 17:22:00.465401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 190/330] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:00 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:00.470326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8ad783c1-5734-4877-93c1-594707ae665b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:00.471087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8ad783c1-5734-4877-93c1-594707ae665b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:00.546814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8ad783c1-5734-4877-93c1-594707ae665b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:00.554324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8ad783c1-5734-4877-93c1-594707ae665b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1213 microversion: 2.1 time: 0.087874 May 10 17:22:00.554925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 191/331] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:00 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:00.639308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:00.639937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:00.651605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.652050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.652841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:00.653319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:00.704183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ee6cffb7-470b-46aa-8591-5f100c9c2152 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28459 microversion: 2.20 time: 0.604075 May 10 17:22:00.705409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 141/332] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:00 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28459 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:00.856517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:00.865823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3d7e224e-1f6c-4a42-bb3e-6579fbfeb542 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.230193 May 10 17:22:00.866781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 192/333] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:00 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:01.028146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:01.029521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:01.052654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.053416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.054502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.055146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.204656 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:01.205285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:01.212665 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.213890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.214869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.215485 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.299694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:01.312737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-25740e2c-be1f-4621-847b-45174618414b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.288746 May 10 17:22:01.320048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 142/334] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:01 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:01.356318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:01.368271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-17cca19c-f564-4d28-b0bc-632197670d20 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1276 microversion: 2.1 time: 0.167225 May 10 17:22:01.369734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 193/335] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:01 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:01.481149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:01.482229 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:01.491545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.492633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.493973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.494608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.572717 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:01.573862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:01.586932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.589961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.591495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.592121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.909772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:01.925841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e8934081-2540-4ebe-942c-b18fbb59fb87 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1265 microversion: 2.1 time: 0.356996 May 10 17:22:01.936544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 194/336] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:01 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:01.944695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:01.946109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:01.964547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.965772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:01.966798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:01.967576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.069141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:02.080172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9cc96b3c-b2db-47d1-9c49-c64acf6286a5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.603029 May 10 17:22:02.080869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 143/337] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:01 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:02.099298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:02.099923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:02.107176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.107628 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.108417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.108842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.241654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f1615f83-6c84-4082-abef-2945c984eeee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.303391 May 10 17:22:02.243622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 195/338] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:01 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:02.331744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:02.332519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:02.345052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.347794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.348611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.351246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.906850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:02.912682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:02.928650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-122acc06-5fe8-4c7c-b775-72ea0c824aed tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.598933 May 10 17:22:02.930190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f12755fb-eb0d-4d1c-ab91-a65dfba01607 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.847963 May 10 17:22:02.930911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 196/339] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:02 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:02.939714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 144/340] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:02 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:02.945575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:02.950010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:02.955738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:02.956374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:02.961341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.965694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.966801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.970983 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.980274 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.980738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:02.981541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:02.981982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.239059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:03.252108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0864bd77-afac-46f8-ab82-80d0fcee04b6 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1271 microversion: 2.1 time: 0.310441 May 10 17:22:03.252706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 145/341] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:02 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:03.268894 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:03.269520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:03.289388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.289856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.290687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.291382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.589122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:03.599426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bca4125b-1182-4f4d-809b-d5f2bd222eb8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.665866 May 10 17:22:03.600359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 197/342] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:02 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:03.605466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:03.606616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:03.614621 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.615075 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.615864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.616320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.751357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:03.761315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-113ebf3b-a17c-4752-b254-bf40cc2356ac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1501 microversion: 2.1 time: 0.496376 May 10 17:22:03.762004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 146/343] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:03 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1501 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:03.766604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-2bca4ccf-a284-4053-8a51-9f60796e6e7e req-c8ef6937-c57e-4d8b-a80e-616eeb4e0fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c232b4-e9fa-4f10-8db8-cabb373ef0c1", "tag": "1bd6f1d7-5140-47ca-a79d-6899fb7d7339"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:03.768400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:03.768400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:03.779439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2bca4ccf-a284-4053-8a51-9f60796e6e7e req-c8ef6937-c57e-4d8b-a80e-616eeb4e0fb7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.779886 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2bca4ccf-a284-4053-8a51-9f60796e6e7e req-c8ef6937-c57e-4d8b-a80e-616eeb4e0fb7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.799339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-2bca4ccf-a284-4053-8a51-9f60796e6e7e req-c8ef6937-c57e-4d8b-a80e-616eeb4e0fb7 service nova] Creating event network-changed:1bd6f1d7-5140-47ca-a79d-6899fb7d7339 for instance d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 on hv-cinder-78638 May 10 17:22:03.804150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-2bca4ccf-a284-4053-8a51-9f60796e6e7e req-c8ef6937-c57e-4d8b-a80e-616eeb4e0fb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040904 May 10 17:22:03.804741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 147/344] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:03.810220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98f0f944-a13f-4cf0-b539-510b1e8a2f5a"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:03.811378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:03.818904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.819365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.820141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.820580 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.879194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] HTTP exception thrown: Cannot 'attach_volume' instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 while it is in vm_state rescued May 10 17:22:03.879792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Returning 409 to user: Cannot 'attach_volume' instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 while it is in vm_state rescued {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:22:03.880620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d6c5ba92-7836-4f61-94e3-1447b3d99461 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074548 May 10 17:22:03.881165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 148/345] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:22:03 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 17:22:03.889939 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:03.890442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:03.897496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.897945 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:03.898751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:03.899229 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.053171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f6659ab9-8e77-40b6-9c88-54e9261fe065 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action" status: 202 len: 0 microversion: 2.1 time: 0.166322 May 10 17:22:04.053982 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 149/346] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:22:03 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:04.060578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:04.061243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:04.068714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.069168 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.069981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.070521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.306485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:04.315194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-47296708-c8c6-430f-a432-8935ac96cc4b tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.259758 May 10 17:22:04.315762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 150/347] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:04 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:04.320149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:04.320760 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:04.328047 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.328585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.329404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.329848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.530734 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:04.539313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e7aa1e18-61f2-4848-a907-a7ac4da2e13b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.222567 May 10 17:22:04.539896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 151/348] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:04 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:04.545317 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:04.545946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:04.554169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.554699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.555530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.556023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.764912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:04.773351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-06efa52c-d751-4481-bedf-da3549a04a68 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.232137 May 10 17:22:04.773938 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 152/349] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:04 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:04.788320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:04.789029 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:04.797411 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.797891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:04.798744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:04.799194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.044470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:05.053276 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-51302580-7173-4c08-a993-f4eb91628013 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.268884 May 10 17:22:05.058398 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 153/350] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:04 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:05.059212 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:05.060614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:05.067477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.068012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.068900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.069419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.269139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:05.278413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2800f34-e41c-4abb-a8e9-2853e42c6f0e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.223387 May 10 17:22:05.279813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 154/351] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:05 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:05.332184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:05.332854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:05.341515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.341971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.342801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.343237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.555237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:05.564645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-01b26150-eaaf-4f3b-af56-8e094b9435dd tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.236242 May 10 17:22:05.570536 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 155/352] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:05 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:05.575926 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:05.576547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:05.583710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.584161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.585075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.585512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.783465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:05.792113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c314866d-02a9-4643-87bb-95a3ab4798ad tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.220231 May 10 17:22:05.792690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 156/353] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:05 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:05.807804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:05.808363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:05.815557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.816015 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:05.816857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:05.817322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.127183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:06.136690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b14557f4-c8aa-492c-bef0-6e537eb9b714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.343009 May 10 17:22:06.137517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 157/354] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:05 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:06.142297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:06.143134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:06.150466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.151006 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.151862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.152446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.360232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:06.370220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-30de5d51-ee95-4534-aabb-8b7ac213080a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.231503 May 10 17:22:06.371213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 158/355] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:06 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:06.383704 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:06.384441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:06.392442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.393026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.393916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.394557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.606872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-57fe6338-d964-47a7-a40c-5074bb1b59a2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 3.004890 May 10 17:22:06.607726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 198/356] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:03 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 3007 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:06.615059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:06.615985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:06.624708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.625393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:06.626375 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:06.626969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.034968 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:07.043511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1447c5b4-9d35-48cb-97a9-3e22f83a843a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.671031 May 10 17:22:07.047833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 159/357] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:06 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:07.059447 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:07.065476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:07.073479 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.073950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.074777 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.075226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.243316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:07.252270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1a760059-8d68-4c2d-baae-5e5056cba51c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.643309 May 10 17:22:07.253076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 199/358] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:06 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:07.267397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:07.268032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:07.277177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.278372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.279548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.280317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.885909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:07.895505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f5a9484a-ba57-44fa-958d-969e77f48962 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.846287 May 10 17:22:07.905693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 160/359] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:07 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:07.912050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:07.913146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:07.921966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.922847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:07.924019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:07.924684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:08.074282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:08.086146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0d1960de-80bc-42ff-9976-15237ad89ecf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.831799 May 10 17:22:08.087338 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 200/360] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:07 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:08.102795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:08.141823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:08.153270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:08.153741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:08.169312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:08.170363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:08.375519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0bfc53b3-b1e0-4314-9d94-c721bba769a1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.286340 May 10 17:22:08.377396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 201/361] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:08 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:08.384372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:08.385916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:08.397524 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:08.398243 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:08.400320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:08.401673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:08.965915 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:08.991764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9a71b723-b7df-4548-84d0-b2ac97055fcc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 1.084003 May 10 17:22:08.996881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 161/362] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:07 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:09.005749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:09.006587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:09.020104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.020777 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.021740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.022588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.082458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:09.102259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b857176b-2907-4870-87d3-78df0f2537fb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.721308 May 10 17:22:09.114214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 202/363] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:08 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:09.124927 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:09.125433 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:09.134091 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.134828 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.135630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.136079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.596381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:09.605245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a475a9ab-ab99-4d2d-9681-6c7901f903b0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.606604 May 10 17:22:09.614636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 162/364] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:08 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:09.614946 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:09.619629 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:09.620244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:09.624846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d5d318c3-7aa3-4fce-b644-2cbf9e9cfdae tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.509264 May 10 17:22:09.625438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 203/365] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:09 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:09.629863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:09.633453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:09.641599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.642049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.642980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.643111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.643440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.643557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.644229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:09.644673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:09.970699 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ea33672e-32c4-4016-8ca8-9fb1f8cf1a30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.343954 May 10 17:22:09.971670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 204/366] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:09 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:09.978742 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-7e5c24f2-c600-466d-837b-34fb8be79883 req-b9dbf864-f174-4e81-b6ec-c635f705c1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298be385-44b2-4f19-bea2-1454d95d9e0a", "tag": "e4ad5f3c-5d64-4539-9849-f35567580284"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:09.997740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:09.997740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:22:10.014520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:10.023649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-349a79af-d89c-406a-8dd7-6b630e2f8160 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.408158 May 10 17:22:10.025922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 163/367] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:09 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:10.026899 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-7e5c24f2-c600-466d-837b-34fb8be79883 req-b9dbf864-f174-4e81-b6ec-c635f705c1c1 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.027582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-7e5c24f2-c600-466d-837b-34fb8be79883 req-b9dbf864-f174-4e81-b6ec-c635f705c1c1 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.037798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:10.038448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:10.071740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-7e5c24f2-c600-466d-837b-34fb8be79883 req-b9dbf864-f174-4e81-b6ec-c635f705c1c1 service nova] Creating event network-changed:e4ad5f3c-5d64-4539-9849-f35567580284 for instance 298be385-44b2-4f19-bea2-1454d95d9e0a on hv-cinder-78638 May 10 17:22:10.078280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.078844 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.079692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.080133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.083236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-7e5c24f2-c600-466d-837b-34fb8be79883 req-b9dbf864-f174-4e81-b6ec-c635f705c1c1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109903 May 10 17:22:10.086925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 205/368] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:10.121220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:10.122024 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:10.131512 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.131964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.132814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.133254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.721777 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:10.736530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c8045818-9ee5-4b43-952c-8f68bcba5be3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.619537 May 10 17:22:10.737368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 206/369] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:10 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:10.746087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:10.747975 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0f5e4e10-40c4-4f8a-9fd1-13dbcc612fe0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.720672 May 10 17:22:10.748551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 164/370] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:10 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:10.758257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:10.758257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:10.763317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:10.763742 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.764207 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.764734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:10.764998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.765445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.776176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.777737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:10.778861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:10.779610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.226253 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:11.236079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:11.241359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-232c59a8-e0f9-4f23-a73c-b14c31235db4 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.491163 May 10 17:22:11.243401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 165/371] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:10 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:11.256628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-09a8edd2-6ea4-47ba-a9f3-248b317824c3 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.508440 May 10 17:22:11.264145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:11.267978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 207/372] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:10 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:11.270489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:11.273995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:11.279266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:11.284909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.285543 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.287396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.289797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.295921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.296730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.300693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.301324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.567445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1a74bfcd-3302-4a30-a3b5-53adba57012f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.321724 May 10 17:22:11.571733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 166/373] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:11 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:11.582297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-8b4da3d5-fcc7-40ef-ad3d-f4a82a3ae59a req-c06c6440-c0ba-4526-ba3f-76717b7d4186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d277ca7-6c54-4455-abee-1158e0b2ac22", "name": "network-vif-plugged", "status": "completed", "tag": "d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:11.583871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:11.583871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:11.614603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8b4da3d5-fcc7-40ef-ad3d-f4a82a3ae59a req-c06c6440-c0ba-4526-ba3f-76717b7d4186 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.615870 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8b4da3d5-fcc7-40ef-ad3d-f4a82a3ae59a req-c06c6440-c0ba-4526-ba3f-76717b7d4186 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.655979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-8b4da3d5-fcc7-40ef-ad3d-f4a82a3ae59a req-c06c6440-c0ba-4526-ba3f-76717b7d4186 service nova] Creating event network-vif-plugged:d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc for instance 0d277ca7-6c54-4455-abee-1158e0b2ac22 on hv-cinder-78638 May 10 17:22:11.667309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-8b4da3d5-fcc7-40ef-ad3d-f4a82a3ae59a req-c06c6440-c0ba-4526-ba3f-76717b7d4186 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092470 May 10 17:22:11.668182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 167/374] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:11.753971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:11.755048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:11.770630 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.773429 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.774263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.774743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.780040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:11.790269 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d2cf7e81-385e-4ce5-8e04-b13f111e8b0d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.520810 May 10 17:22:11.791825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 208/375] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:11 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:11.797318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:11.798281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:11.808892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.809594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:11.810570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:11.811358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:12.575707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:12.586845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-01cd88fb-3499-468d-891c-622e522b6cec tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.793634 May 10 17:22:12.598140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 209/376] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:11 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:12.610899 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:12.611591 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:12.623752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:12.624352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:12.625447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:12.626068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:12.652662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:12.667568 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-55873be2-4745-4032-b906-0e3821863ddb tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.915980 May 10 17:22:12.668848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 168/377] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:11 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:12.674083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:12.675014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:12.684340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:12.685157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:12.686178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:12.686738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:12.991735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:13.003551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-114e2e02-07d0-4f32-8505-a6f6c643cb21 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.404150 May 10 17:22:13.014803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 210/378] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:12 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:13.020499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:13.021490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:13.036970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.039398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.040283 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.041239 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.092224 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:13.106275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-beb6133a-c967-422d-8e59-ee3233dfeb2e tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.435772 May 10 17:22:13.109858 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 169/379] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:12 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:13.116811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:13.117681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:13.130269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.131143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.132261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.132920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.388241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-53716085-d9c5-43a2-96ba-17e7092ee4ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.371766 May 10 17:22:13.391703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 211/380] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:13 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:13.424881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:13.438871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fe996d0f-8eda-41f6-93f0-833fba09c956 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1509 microversion: 2.1 time: 0.324734 May 10 17:22:13.449578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 170/381] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:13 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:13.605753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:13.609547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:13.620536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.621234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.622396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.622992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.684752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:13.685940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:13.704728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.705182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:13.706148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:13.707114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.183988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:14.194505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0b2a972f-28de-4c34-9d02-d7c5bfbef76b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.592975 May 10 17:22:14.203935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:14.204101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 212/382] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:13 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:14.210547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-ece17a92-54a8-41a6-af2c-75c9242fd291 req-b374accb-2926-4ae1-98d2-a112c89dcba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e932c1fd-4400-4eee-87e0-653b3de9b593", "name": "network-vif-plugged", "status": "completed", "tag": "e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:14.212173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:14.212173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:22:14.214574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4fb83c9e-302f-46af-915b-5c5769b5bc55 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.533630 May 10 17:22:14.215931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 171/383] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:13 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:14.224627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:14.231260 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:14.236336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-ece17a92-54a8-41a6-af2c-75c9242fd291 req-b374accb-2926-4ae1-98d2-a112c89dcba3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.236810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-ece17a92-54a8-41a6-af2c-75c9242fd291 req-b374accb-2926-4ae1-98d2-a112c89dcba3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.244744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.245203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.246271 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.246830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.262791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-ece17a92-54a8-41a6-af2c-75c9242fd291 req-b374accb-2926-4ae1-98d2-a112c89dcba3 service nova] Creating event network-vif-plugged:e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6 for instance e932c1fd-4400-4eee-87e0-653b3de9b593 on hv-cinder-78638 May 10 17:22:14.268899 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-ece17a92-54a8-41a6-af2c-75c9242fd291 req-b374accb-2926-4ae1-98d2-a112c89dcba3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062125 May 10 17:22:14.269582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 213/384] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:14.278760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:14.280010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:14.295217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.296255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.302644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.303439 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.866009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:14.879406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0591b954-64fe-4d62-a8e2-fdce84ccadf0 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.658592 May 10 17:22:14.880032 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 172/385] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:14 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:14.891855 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:14.897565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:14.914058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.914567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:14.915370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:14.915864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.035462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:15.057493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-12b64787-e4e0-4cd3-8069-c9bd4a3a5938 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1314 microversion: 2.1 time: 0.783441 May 10 17:22:15.058238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 214/386] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:14 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:15.091421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:15.092058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:15.108897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.109296 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.110089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.110558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.383277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:15.393340 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-93613eaa-d36a-4715-884f-96cc3967c77d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1515 microversion: 2.1 time: 0.324862 May 10 17:22:15.394300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 215/387] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:15 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:15.399010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:15.399775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:15.408707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.413931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.414810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.415264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.569261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-381c0bc0-1081-45f8-a099-410e82c63dc2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.687250 May 10 17:22:15.570494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 173/388] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:14 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:15.579337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:15.580790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:15.601404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.602997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.604127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.606274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.877604 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:15.894725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-77f98f77-0246-4727-b771-99a9948421d9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.499177 May 10 17:22:15.906108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 216/389] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:15 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:15.917475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:15.918382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:15.936818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.940129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:15.942815 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:15.943463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.067978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:16.080423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-afe4e25a-28b6-4857-b928-ed6455be2457 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.508410 May 10 17:22:16.090910 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 174/390] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:15 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:16.101492 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:16.115226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:16.143874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.144488 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.146897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.147456 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.591835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:16.602804 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ab28d287-2740-4bef-9096-5fc118b5b861 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1319 microversion: 2.1 time: 0.698194 May 10 17:22:16.603578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 217/391] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:15 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1319 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:16.618549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:16.630647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dc790fd6-6a29-4093-9ea5-d671ff349479 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1463 microversion: 2.1 time: 0.538239 May 10 17:22:16.633459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:16.635191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:16.636421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 175/392] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:16 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1463 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:16.644265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.644724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.645527 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.646006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.714870 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:16.715387 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:16.725327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.725550 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.726385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.726977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.813522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:22:16.839817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d356c1de-9039-40fb-a182-0821f4443681 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.214406 May 10 17:22:16.841160 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 218/393] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:16 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:16.913717 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:16.914961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:16.927904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.928623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.929611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:16.930210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:16.977717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f038184f-7794-4278-987e-5159c030b051 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 204 len: 0 microversion: 2.1 time: 0.266229 May 10 17:22:16.979047 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 176/394] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:22:16 2021] DELETE /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:22:16.987887 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:16.988864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:17.004922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.005972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.008000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.008799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.397919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:17.411049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-99afb841-c6d3-4b52-92f0-c1ef4addce19 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.501471 May 10 17:22:17.423738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 219/395] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:16 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:17.432997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:17.442239 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:17.444942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:17.448823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9653817b-4e25-495e-9c4e-7ab5a414ede0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1469 microversion: 2.1 time: 0.463240 May 10 17:22:17.451557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 177/396] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:16 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:17.461597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:17.462643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:17.468408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.469457 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.471189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.472258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.473096 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.473648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.475121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.475664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.819194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:17.839136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-96cd91dd-a54c-4fe9-bdb1-ee4b9338c7ca tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1515 microversion: 2.1 time: 0.376441 May 10 17:22:17.839784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 178/397] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:17 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:17.850740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:17.851538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:17.867221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:17.874747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.876100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.877019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.878869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.885550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f4d88e53-8b97-48dd-b883-be229d8b43f5 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.460256 May 10 17:22:17.886140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 220/398] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:17 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:17.893965 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:17.896728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:17.917154 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.917620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:17.918453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:17.918902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.067769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f1c0f509-71af-4d56-9ae6-530b7d04de06 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.180280 May 10 17:22:18.068490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 221/399] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:17 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:18.074242 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b231bb1-7213-4a38-a361-22f909840848"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:18.086294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:18.097192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.097911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.099171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.099867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.206989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:18.217274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-68446a21-5ff0-4853-af75-0e42df1efa09 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1506 microversion: 2.1 time: 0.376273 May 10 17:22:18.218234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 179/400] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:17 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:18.430568 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:18.431417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:18.447465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.448098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.448811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.449221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.661435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eceef7bd-6bd5-46b9-9c9c-132cbce56fff tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591172 May 10 17:22:18.662460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 222/401] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:22:18 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments => generated 194 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:18.684617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:18.685425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:18.701834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.704661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:18.705391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.706402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.707086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.718676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ae4c85a3-ea70-4efa-88eb-1d19c57926a0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.291747 May 10 17:22:18.719487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 180/402] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:18 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:18.878449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-24a9f417-e5a4-4c7a-a0a8-280a2e178f09 req-4549d124-90a0-4f3b-b6d3-602c79083e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c232b4-e9fa-4f10-8db8-cabb373ef0c1", "name": "network-vif-plugged", "status": "completed", "tag": "1bd6f1d7-5140-47ca-a79d-6899fb7d7339"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:18.880210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:18.880210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:18.901070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-24a9f417-e5a4-4c7a-a0a8-280a2e178f09 req-4549d124-90a0-4f3b-b6d3-602c79083e38 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:18.901070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-24a9f417-e5a4-4c7a-a0a8-280a2e178f09 req-4549d124-90a0-4f3b-b6d3-602c79083e38 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:18.947048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-24a9f417-e5a4-4c7a-a0a8-280a2e178f09 req-4549d124-90a0-4f3b-b6d3-602c79083e38 service nova] Creating event network-vif-plugged:1bd6f1d7-5140-47ca-a79d-6899fb7d7339 for instance d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 on hv-cinder-78638 May 10 17:22:18.959395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-24a9f417-e5a4-4c7a-a0a8-280a2e178f09 req-4549d124-90a0-4f3b-b6d3-602c79083e38 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091143 May 10 17:22:18.963666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 181/403] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:19.003175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:19.011657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:19.057176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.058859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:19.068249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.068804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:19.248027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:19.263369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f02c6e1d-9b93-49bf-80e2-88b2cda33f6c tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1469 microversion: 2.1 time: 0.599495 May 10 17:22:19.264726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 223/404] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:18 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:19.277904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:19.279214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:19.301954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.302805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:19.304295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.305999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:19.566852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7e21dd53-196c-4498-94ca-1540bc074d37 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.300544 May 10 17:22:19.567546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 224/405] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:19 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:19.619532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:19.631799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6bd65f64-5bae-42c9-8178-b5a750c97c57 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 0.665947 May 10 17:22:19.634879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 182/406] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:18 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:19.739311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:19.740935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:19.750883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.751492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:19.752413 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:19.753093 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.281542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:20.282256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:20.298548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.305462 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.307862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.308318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.489221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:20.497819 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7ebfb779-a463-4d36-8461-726b0dbe7cc9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.764630 May 10 17:22:20.515312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 225/407] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:19 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:20.579106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:20.580430 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:20.591563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.592771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.593577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.594180 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.775385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5e772aee-e414-4331-a63e-ca011902a721 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.200267 May 10 17:22:20.780691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 226/408] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:20 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:20.788444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:20.792610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:20.805192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.807889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:20.811342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:20.813124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:21.501137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:21.514607 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-140cea40-0af6-4e9d-8d42-9432bd14c8ea tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1469 microversion: 2.1 time: 1.236847 May 10 17:22:21.518879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 183/409] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:20 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1469 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:21.529816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:21.530741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:21.543555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:21.543819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:21.544619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:21.545067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:21.900482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:21.928016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-25e5eaeb-74a1-4be9-a966-d50d92541663 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1318 microversion: 2.1 time: 1.139539 May 10 17:22:21.928951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 227/410] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:20 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1318 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:21.942915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-85d60b40-1790-4f4f-8ef9-da0f6e019576 req-decf6447-e0cc-465e-8150-c058c6ab1f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d277ca7-6c54-4455-abee-1158e0b2ac22", "name": "network-vif-deleted", "tag": "d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:21.944723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:21.944723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:22:21.973279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-85d60b40-1790-4f4f-8ef9-da0f6e019576 req-decf6447-e0cc-465e-8150-c058c6ab1f30 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:21.974609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-85d60b40-1790-4f4f-8ef9-da0f6e019576 req-decf6447-e0cc-465e-8150-c058c6ab1f30 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.028085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-85d60b40-1790-4f4f-8ef9-da0f6e019576 req-decf6447-e0cc-465e-8150-c058c6ab1f30 service nova] Creating event network-vif-deleted:d06f6ffe-1b79-42f8-a81d-1cb0961f1dcc for instance 0d277ca7-6c54-4455-abee-1158e0b2ac22 on hv-cinder-78638 May 10 17:22:22.039035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-85d60b40-1790-4f4f-8ef9-da0f6e019576 req-decf6447-e0cc-465e-8150-c058c6ab1f30 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108544 May 10 17:22:22.044135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 228/411] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:22.059559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:22.060954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:22.078672 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.082705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.083979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.085354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.104804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:22.115592 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d386f0db-8737-4128-92dd-fe474e6bdb50 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.595428 May 10 17:22:22.116175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 184/412] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:21 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:22.144516 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-792de244-09ef-4c87-b1df-a856aea6eac2 req-f5f97cb6-01bc-4347-841d-3f87079a6ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298be385-44b2-4f19-bea2-1454d95d9e0a", "name": "network-vif-plugged", "status": "completed", "tag": "e4ad5f3c-5d64-4539-9849-f35567580284"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:22.146116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:22.146116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:22.183094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-792de244-09ef-4c87-b1df-a856aea6eac2 req-f5f97cb6-01bc-4347-841d-3f87079a6ffb service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.188452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-792de244-09ef-4c87-b1df-a856aea6eac2 req-f5f97cb6-01bc-4347-841d-3f87079a6ffb service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.230880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-792de244-09ef-4c87-b1df-a856aea6eac2 req-f5f97cb6-01bc-4347-841d-3f87079a6ffb service nova] Creating event network-vif-plugged:e4ad5f3c-5d64-4539-9849-f35567580284 for instance 298be385-44b2-4f19-bea2-1454d95d9e0a on hv-cinder-78638 May 10 17:22:22.238266 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-792de244-09ef-4c87-b1df-a856aea6eac2 req-f5f97cb6-01bc-4347-841d-3f87079a6ffb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097326 May 10 17:22:22.240033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 185/413] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:22:22.337901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9f8ae1aa-ea74-4ba6-a245-ac60b50b562f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.292016 May 10 17:22:22.338586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 229/414] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:22 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:22.537489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:22.538814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:22.547455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.548900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.550715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.551408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.702213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.702812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.703396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lazy-loading 'fault' on Instance uuid 0d277ca7-6c54-4455-abee-1158e0b2ac22 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:22:22.947936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:22.949236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:22.976053 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.976517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.977332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:22.977776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:22.997464 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf64a132c244c5c85aaf84a3ecfa686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c903c1d087f2488ca43f869d75ba30d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:23.030402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-41730215-12ae-48ea-b651-7f948b953033 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 200 len: 1304 microversion: 2.1 time: 0.497042 May 10 17:22:23.033806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 186/415] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:22 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 1304 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:23.133993 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:23.134748 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:23.163109 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:23.163565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:23.170316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:23.170811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:23.596658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:23.627824 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-edaf7302-8437-4695-b04d-4f06a3d3765b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1508 microversion: 2.1 time: 0.684157 May 10 17:22:23.628359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 230/416] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:22 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1508 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:23.635635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:23.643985 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:23.649554 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:23.664908 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7a98435f-7be7-4f17-ba26-fb2a7c68a7f8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.535505 May 10 17:22:23.666078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 187/417] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:23 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:23.672325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:23.672792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:23.673585 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:23.674087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:23.844964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d1fe6037-ee37-4844-a0a6-cc5ef48c92a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.215282 May 10 17:22:23.849855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 231/418] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:23 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:24.052325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:24.053039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] [instance: 0d277ca7-6c54-4455-abee-1158e0b2ac22] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:24.081054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.081865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:24.083035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.083717 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:24.161983 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] HTTP exception thrown: Instance 0d277ca7-6c54-4455-abee-1158e0b2ac22 could not be found. May 10 17:22:24.162936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] Returning 404 to user: Instance 0d277ca7-6c54-4455-abee-1158e0b2ac22 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:22:24.164119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f1f42968-d92c-4fae-8f2b-af342dd5f6d0 tempest-VolumesNegativeTest-448294323 tempest-VolumesNegativeTest-448294323-project] 10.222.0.32 "GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22" status: 404 len: 111 microversion: 2.1 time: 0.117062 May 10 17:22:24.165213 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 232/419] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:24 2021] GET /compute/v2.1/servers/0d277ca7-6c54-4455-abee-1158e0b2ac22 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:22:24.325476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Action: 'create', calling method: .version_select at 0x7f41445ffc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-547954858"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:24.354280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:22:24.359909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for user 0e59d19771484ad188993b1bcccba538 and project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:22:24.685916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:24.686802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:24.696270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:22:24.698686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.699718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:24.700857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for user 0e59d19771484ad188993b1bcccba538 and project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:22:24.701008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.701616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:24.716585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-55644bf4-d452-45bf-bea4-f02ddfebbbb6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.765141 May 10 17:22:24.717240 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 188/420] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 10 17:22:23 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:24.858293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:24.859228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:24.868076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.869243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:24.870196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:24.870818 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:25.055773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c8b2263c-b53f-4809-a41f-bcc6118cb0d1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.201995 May 10 17:22:25.056446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 189/421] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:24 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:25.075480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:25.085359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cbb7390d-e770-42d1-a203-7d6a70a587c3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1313 microversion: 2.1 time: 0.406701 May 10 17:22:25.095257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 233/422] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:24 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:25.444940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23964ff5-b9f3-4404-bc95-bfcb8d89954a"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:25.446108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:25.454627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:25.455169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:25.455881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:25.456331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:26.069962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:26.071227 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:26.082143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:26.082751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:26.083465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:26.084102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:26.141667 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0d768464-04dd-48e1-a226-9b0e8736c7cc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701391 May 10 17:22:26.143467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 190/423] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:22:25 2021] POST /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:26.152811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:26.154869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:26.166742 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:26.167390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:26.168408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:26.169374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:26.361203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6c8c4ad3-7908-4e24-badb-2ab2d32a73e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.297332 May 10 17:22:26.361734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 234/424] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:26 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:26.446498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:26.456383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d9cc985f-cb6d-46a9-89aa-9373daa8a6f7 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1498 microversion: 2.1 time: 0.311178 May 10 17:22:26.457290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 191/425] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:26 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1498 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:27.374111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:27.375780 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:27.384496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:27.385145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:27.386165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:27.386849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:27.531577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1c8d2984-b3ed-4c36-ab9d-5326de2b9d15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.162458 May 10 17:22:27.532907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 235/426] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:27 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:27.853174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:27.854285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:27.871004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:27.871667 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:27.872636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:27.873237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:27.989161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:22:28.130087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1431a37a-61f4-483e-a78f-d580d95f35b5 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "DELETE /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 204 len: 0 microversion: 2.1 time: 0.278229 May 10 17:22:28.131117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 192/427] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:22:27 2021] DELETE /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:22:28.140405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:28.141120 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:28.150507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.151046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.152191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.153195 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.367281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:28.376263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7f4c0ccc-4598-4633-9b40-11c9ee007341 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1504 microversion: 2.1 time: 0.240266 May 10 17:22:28.386334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 236/428] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:28 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:28.546415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:28.547619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:28.559289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.559802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.560780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.561512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.708836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ff17b108-8c22-4515-85ed-5fa1a99aa919 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.167683 May 10 17:22:28.709699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 193/429] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:28 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:28.719677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:28.721104 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:28.729963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.730456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.731255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:28.731695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:28.798051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'flavor' on Instance uuid 568c5267-2f2c-4d3b-8364-a05c2b8192b1 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:22:29.149445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-83d89a6c-cfba-45ac-81c5-6bd2c5c7ef71 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action" status: 200 len: 32 microversion: 2.1 time: 0.434148 May 10 17:22:29.150503 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 237/430] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:22:28 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action => generated 32 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:22:29.161228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:29.162893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:29.173882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.174434 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.175290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.175735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.394736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:29.395591 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:29.404018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.404606 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.405502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.406049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.544574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:29.570233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2ab8a342-906a-430a-b9bf-141b277720c6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.413571 May 10 17:22:29.570860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 194/431] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:29 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:29.722319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:29.723476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:29.732591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.734678 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.735729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:29.736241 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:29.900822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a3f12e8e-c2d4-4ec3-b8d4-f8e2775cdb19 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.182409 May 10 17:22:29.901472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 195/432] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:29 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:29.989370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:30.001200 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6834ab09-b384-4bdd-90a9-50bca7d04780 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1504 microversion: 2.1 time: 0.611092 May 10 17:22:30.024433 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 238/433] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:29 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:30.588790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:30.589384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:30.597553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:30.598013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:30.598834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:30.599537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:30.912674 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:30.914487 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:30.922772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:30.923233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:30.924150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:30.924913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:30.992508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:31.008070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0666f825-9b0d-4088-bfc7-2b816f51adb7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.423505 May 10 17:22:31.008673 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 196/434] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:30 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:31.032274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:31.032957 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:31.041804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:31.042587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:31.043787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:31.044300 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:31.079508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e5a7d213-2120-47a6-9f2f-b8ecffdc2769 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.170461 May 10 17:22:31.080169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 239/435] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:30 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:31.476215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:31.486562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1803b907-2e60-453f-8e01-cd5a4762256a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 200 len: 1504 microversion: 2.1 time: 0.458249 May 10 17:22:31.487137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 197/436] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:31 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:31.661083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-1f6a1d6b-f915-4333-9e4e-118389577888 req-f99e2eef-02d7-46a9-a598-d5d663abfb0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298be385-44b2-4f19-bea2-1454d95d9e0a", "name": "network-vif-deleted", "tag": "e4ad5f3c-5d64-4539-9849-f35567580284"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:31.663360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:31.663360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:22:31.674841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-1f6a1d6b-f915-4333-9e4e-118389577888 req-f99e2eef-02d7-46a9-a598-d5d663abfb0f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:31.675936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-1f6a1d6b-f915-4333-9e4e-118389577888 req-f99e2eef-02d7-46a9-a598-d5d663abfb0f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:31.692994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-1f6a1d6b-f915-4333-9e4e-118389577888 req-f99e2eef-02d7-46a9-a598-d5d663abfb0f service nova] Creating event network-vif-deleted:e4ad5f3c-5d64-4539-9849-f35567580284 for instance 298be385-44b2-4f19-bea2-1454d95d9e0a on hv-cinder-78638 May 10 17:22:31.697870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-1f6a1d6b-f915-4333-9e4e-118389577888 req-f99e2eef-02d7-46a9-a598-d5d663abfb0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042358 May 10 17:22:31.698646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 240/437] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:32.025652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:32.026589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:32.034109 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.034593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.035379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.035819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.094590 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:32.095997 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:32.108684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.109147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.110164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.110776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.234157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:32.244154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d11e77e1-4446-4c7a-8439-38c5ebdde25d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.222354 May 10 17:22:32.244913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 198/438] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:32 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:32.276933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-01f1a55c-e476-40fa-976c-1d6e479bfaa0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.188257 May 10 17:22:32.277680 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 241/439] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:32 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:32.503614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:32.504232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: 298be385-44b2-4f19-bea2-1454d95d9e0a] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:32.511862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.512319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.513097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:32.513538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:32.568463 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] HTTP exception thrown: Instance 298be385-44b2-4f19-bea2-1454d95d9e0a could not be found. May 10 17:22:32.568988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Returning 404 to user: Instance 298be385-44b2-4f19-bea2-1454d95d9e0a could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:22:32.569845 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6d0ac835-5431-4482-a5d7-631004c425fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a" status: 404 len: 111 microversion: 2.1 time: 0.070109 May 10 17:22:32.570425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 199/440] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:32 2021] GET /compute/v2.1/servers/298be385-44b2-4f19-bea2-1454d95d9e0a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:22:32.678891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-986181061", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "247b7704-949d-47ff-a7d6-c3dc7a6e8e45"}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:33.260931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:33.261584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:33.268877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:33.269333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:33.270108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:33.270581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:33.571298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:33.579854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ffcf5d2b-00e8-4371-90a3-e92382103cfc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.322763 May 10 17:22:33.580420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 200/441] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:33 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:33.584778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:33.585723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:33.592584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:33.593042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:33.593832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:33.594281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:33.749406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1120a3b3-7378-4309-affd-a398ce67e7fb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.167487 May 10 17:22:33.750061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 201/442] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:33 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:34.598458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:34.599865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:34.608659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:34.609114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:34.609934 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:34.610392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:34.812977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:34.822302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7d0a0e40-392c-4e70-8a42-bfcc58480254 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.229014 May 10 17:22:34.822889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 202/443] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:34 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:34.827259 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:34.828281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:34.835151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:34.835610 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:34.836396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:34.836841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:35.011491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3ddc9f24-626c-4c10-8a5d-a66eeae19d98 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.187199 May 10 17:22:35.013034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 203/444] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:34 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:35.620243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23964ff5-b9f3-4404-bc95-bfcb8d89954a"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:35.621412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:35.629750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:35.630208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:35.631058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:35.631500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:35.791502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Invalid volume: volume 23964ff5-b9f3-4404-bc95-bfcb8d89954a is already attached to instances: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 May 10 17:22:35.792114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 400 to user: Invalid volume: volume 23964ff5-b9f3-4404-bc95-bfcb8d89954a is already attached to instances: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:22:35.792943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a1c5a57e-7daf-42b1-b022-e63a5b5baecf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178114 May 10 17:22:35.793483 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 204/445] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:22:35 2021] POST /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments => generated 174 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 17:22:35.839466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:35.840071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:35.847311 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:35.847766 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:35.848536 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:35.848972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:36.048273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:36.057514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5e2ccddf-6719-4d37-a6a9-1d4a5ed21e39 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.222278 May 10 17:22:36.058072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 205/446] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:35 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:36.062653 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:36.063149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:36.069834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:36.070282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:36.071084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:36.071519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:36.233103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'services' on Instance uuid d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:22:36.367174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fb4baa5f-43de-4b89-9239-889c0c12582a tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments/23964ff5-b9f3-4404-bc95-bfcb8d89954a" status: 202 len: 0 microversion: 2.1 time: 0.307817 May 10 17:22:36.367782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 206/447] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:22:36 2021] DELETE /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1/os-volume_attachments/23964ff5-b9f3-4404-bc95-bfcb8d89954a => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:36.373514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:36.374686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:36.382651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:36.383117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:36.384163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:36.384662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:36.529469 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e0c13a8b-2786-4955-a17c-c7da7b53e1e4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.160211 May 10 17:22:36.533784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 207/448] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:36 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:37.076194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:37.077016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:37.086269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:37.086753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:37.088189 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:37.088633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:37.291309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:37.300089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-929320c1-3419-4e5c-9353-7c978a890b43 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.229423 May 10 17:22:37.300661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 208/449] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:37 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:37.541463 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:37.542675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:37.550188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:37.550679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:37.551526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:37.551984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:37.707396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c792c957-8d08-4ca7-888c-e586f8c41565 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.169425 May 10 17:22:37.708052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 209/450] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:37 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:38.317574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:38.318270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:38.327327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:38.327782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:38.328582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:38.329025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:38.533940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:38.543339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0526d983-a27b-4bc4-9e46-e5e4b9b1bcac tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.230095 May 10 17:22:38.543913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 210/451] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:38 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:38.719113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:38.720040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:38.730438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:38.730438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:38.730438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:38.730438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:38.905031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-999fdd75-4c85-45a3-8e49-169c0bbd8243 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.189564 May 10 17:22:38.905670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 211/452] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:38 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:22:38.910851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-391399695", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "0cfd4b2e-df56-43d0-908b-ea446d61e6b9"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:39.930986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] validate_networks() for [('0cfd4b2e-df56-43d0-908b-ea446d61e6b9', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:22:39.932447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] validate_networks() for [('247b7704-949d-47ff-a7d6-c3dc7a6e8e45', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:22:40.815437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:22:40.815867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:22:40.816343 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:22:40.816757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:22:40.817169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:22:40.826062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.826553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.827368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.827805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.831289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:22:40.831719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:22:40.832197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:22:40.832634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:22:40.833057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:22:40.841512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.841946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.842792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.843239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.845399 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Getting quotas for project 74edb2011cde4bfcb01eceaf97474332. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:22:40.849698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Getting quotas for user e39c8835b96944e780c5b462d7c93a8d and project 74edb2011cde4bfcb01eceaf97474332. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:22:40.860575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:22:40.860995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:22:40.863049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:22:40.865153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Getting quotas for user a32fb4db0ebb499a9cf1103e888cbbc6 and project d0f782c325f1445b94f0ff94b78c2c9f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:22:40.876461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:22:40.879038 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:22:40.910876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-90deea6b-5894-4929-99a3-da695a2b9f11 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.236058 May 10 17:22:40.916730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 242/453] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:22:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 8238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:22:40.916730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:40.917386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:40.923806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1bd83dd8-d09c-42e0-aecd-a705c54b2aa8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.016924 May 10 17:22:40.929094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.929246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 212/454] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:22:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:22:40.929329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.929329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.929329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.929567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:40.930496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:40.939687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.940296 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:40.941220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:40.941734 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:41.169779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ba1c7c21-1848-4602-b7a5-7f7e3a12ab69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.243574 May 10 17:22:41.171022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 213/455] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:40 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:41.178465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5dd24bc5-683b-4345-ae27-5e6d24cce142 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:41.179733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5dd24bc5-683b-4345-ae27-5e6d24cce142 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:41.390853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5dd24bc5-683b-4345-ae27-5e6d24cce142 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:41.398898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5dd24bc5-683b-4345-ae27-5e6d24cce142 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1213 microversion: 2.1 time: 0.225747 May 10 17:22:41.399468 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 214/456] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:41 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1213 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:41.404139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:41.404750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:41.412612 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:41.413065 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:41.413848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:41.414286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:41.427472 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:41.438653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3a7c1f25-0d4e-4bc7-9e50-4c6ec7d1fdb6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.525844 May 10 17:22:41.443181 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 243/457] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:40 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:41.531833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:41.541121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-69ad8706-d8de-406f-a64b-4b6b95581ad8 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1221 microversion: 2.1 time: 0.139636 May 10 17:22:41.541713 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 215/458] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:41 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:42.181753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:42.199666 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:42.207264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.207721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.208517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.208973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.354947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5b4021b5-f7a4-4e09-b308-7cc2b3ddb65a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.177236 May 10 17:22:42.355820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 244/459] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:42 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:42.415124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:42.416518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:42.424379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.425124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.426165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.426690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.462429 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:42.463209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:42.471346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.471808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.472589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.473220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.652646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:42.660776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c5c1337a-ba00-487b-90e0-e333fd5ef81a tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1265 microversion: 2.1 time: 0.249471 May 10 17:22:42.661344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 216/460] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:42 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:42.666274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:42.667286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:42.674681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.675139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.675947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:42.676389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:42.815485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:42.824331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dc6cedff-e741-445f-84a7-71d3ac3b3f8b tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1275 microversion: 2.1 time: 0.161917 May 10 17:22:42.834510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 217/461] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:42 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:42.946139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:42.956251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3764f9a7-ffcd-4600-a61d-9d75cc5852cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.499511 May 10 17:22:42.957481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 245/462] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:42 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:43.367087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:43.369212 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:43.392527 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.400213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.401358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.402148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.562715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-14cc237b-04de-4b84-aa67-520f4c6cf156 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.199191 May 10 17:22:43.564221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 218/463] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:43 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:43.679927 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:43.679927 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:43.689724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.690473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.691327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.692051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.847360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:43.855740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:43.865587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:43.865771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.866293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.870856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:43.871150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:43.876194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1fdc3394-19d6-4904-991e-0eeda608d29e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1271 microversion: 2.1 time: 0.201030 May 10 17:22:43.877245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 246/464] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:43 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:43.973454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:43.974086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:44.002557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.003950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.005030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.006901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.703548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:44.712179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-88e8f78e-9f77-4587-800b-f5cd318d046c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.742950 May 10 17:22:44.712754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 247/465] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:43 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:44.726264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:44.727212 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:44.732451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:44.736282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.736749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.737633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.738102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.741713 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-40118def-da05-4c95-ab10-5456cea1c3fe tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.904094 May 10 17:22:44.751733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 219/466] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:43 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:44.892886 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:44.893508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:44.901794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.902254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.903067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:44.903513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:44.919622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-66db9666-fe00-444f-bddc-ed50330b4a79 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.196943 May 10 17:22:44.920798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 248/467] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:44 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:45.456289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:45.465248 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-47df9fcb-9a2b-44bb-a721-7c5167d8b34f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.576088 May 10 17:22:45.465733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 220/468] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:44 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:45.730972 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:45.731703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:45.740331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:45.740851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:45.741648 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:45.742093 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:45.759031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:45.759872 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:45.767651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:45.768382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:45.769171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:45.769614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.292019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:46.300762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-66e05fce-c75e-4170-9390-85b8bfc49d6f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.575111 May 10 17:22:46.301830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 249/469] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:45 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:46.305842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:46.307378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:46.314550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:46.315008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.315884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:46.316356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.401763 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:46.413664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-828ce55a-2891-4764-b684-cac0b0cbd282 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.658174 May 10 17:22:46.414156 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 221/470] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:45 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:46.429578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-f4cdd0fb-5309-438a-806e-5411dbac24f0 req-100e2286-e1c8-42dd-9b12-8988e7c69acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04c824b-a74d-4951-80a9-0a37e0c67b95", "tag": "f45c4d8b-c6fb-4cff-8ecf-637d4b509510"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:46.431151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:46.431151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:46.439794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f4cdd0fb-5309-438a-806e-5411dbac24f0 req-100e2286-e1c8-42dd-9b12-8988e7c69acc service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:46.440626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f4cdd0fb-5309-438a-806e-5411dbac24f0 req-100e2286-e1c8-42dd-9b12-8988e7c69acc service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.456402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-f4cdd0fb-5309-438a-806e-5411dbac24f0 req-100e2286-e1c8-42dd-9b12-8988e7c69acc service nova] Creating event network-changed:f45c4d8b-c6fb-4cff-8ecf-637d4b509510 for instance b04c824b-a74d-4951-80a9-0a37e0c67b95 on hv-cinder-78638 May 10 17:22:46.460938 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-f4cdd0fb-5309-438a-806e-5411dbac24f0 req-100e2286-e1c8-42dd-9b12-8988e7c69acc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034821 May 10 17:22:46.461538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 222/471] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:22:46.482969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:46.483688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:46.491219 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:46.491740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.492442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:46.492881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:46.502478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4ea97fa5-ac08-455d-872a-508e96b608d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.199686 May 10 17:22:46.503191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 250/472] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:46 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:47.010426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:47.020236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a7b6eb56-9426-4e49-97bb-90bdb95764cc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.541334 May 10 17:22:47.021000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 223/473] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:46 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:47.318609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:47.319355 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:47.328346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.328800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.329596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.330038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.431309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:47.431876 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:47.441674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.442127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.442943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.443381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.938289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:47.948879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7c117f1b-e0d3-4036-acaf-e02dc6f4ac70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.634439 May 10 17:22:47.949517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 251/474] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:47 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:47.954429 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:47.955844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:47.963683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.964138 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.964930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:47.965405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:47.991765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:48.000563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3512205e-d02a-4f25-b97b-380c73c2625c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.573573 May 10 17:22:48.001134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 224/475] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:47 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:48.036828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:48.037758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:48.046092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:48.046664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:48.047563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:48.048082 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:48.247317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-33198e0e-bff9-4de6-bcc4-f382470f0075 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.296125 May 10 17:22:48.247882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 252/476] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:47 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:48.371656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:48.381888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2e3c24c5-aa43-4932-99b4-c243632c59e2 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.346995 May 10 17:22:48.381888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 225/477] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:48 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:48.510536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-d6d6c2c8-56ad-4a0a-85bb-6be95028cc33 req-21499871-5138-4007-815b-6ef7251b4e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6274f01-93d9-42e0-99ee-a9e40aca8eaf", "tag": "e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:48.512015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:48.512015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:22:48.520879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-d6d6c2c8-56ad-4a0a-85bb-6be95028cc33 req-21499871-5138-4007-815b-6ef7251b4e66 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:48.521327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-d6d6c2c8-56ad-4a0a-85bb-6be95028cc33 req-21499871-5138-4007-815b-6ef7251b4e66 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:48.539347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-d6d6c2c8-56ad-4a0a-85bb-6be95028cc33 req-21499871-5138-4007-815b-6ef7251b4e66 service nova] Creating event network-changed:e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d for instance a6274f01-93d9-42e0-99ee-a9e40aca8eaf on hv-cinder-78638 May 10 17:22:48.544696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-d6d6c2c8-56ad-4a0a-85bb-6be95028cc33 req-21499871-5138-4007-815b-6ef7251b4e66 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038280 May 10 17:22:48.545475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 253/478] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:48.965362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:48.965984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:48.973594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:48.974075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:48.975148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:48.975586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.018491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:49.019664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:49.033925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.034415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.035214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.035658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.734451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:49.743335 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d7c6d9e2-2d96-45d0-a873-2c19cea689bc tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.782261 May 10 17:22:49.744455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 226/479] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:48 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:49.748850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:49.749812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:49.757034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.757579 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.758382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.758832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.762805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:49.771384 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-206393af-0459-45e3-8f66-0fcaff317918 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.757961 May 10 17:22:49.771966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 254/480] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:49 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:49.776715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:49.777702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:49.785582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.786139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.787189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:49.787747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:49.939728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0339b59b-95e5-4cfb-8ec0-c9e3b83d4fa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.193982 May 10 17:22:49.942378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 227/481] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:49 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:50.168781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:50.176891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-188ab61a-3a5b-4c06-9a1a-2b009ee1166c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.403708 May 10 17:22:50.177454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 255/482] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:49 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:50.761253 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:50.761967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:50.769912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:50.770396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:50.771177 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:50.771622 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:50.787769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:50.788391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:50.795668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:50.796123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:50.796897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:50.797346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:51.065583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:51.075202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-492a742b-bed8-4708-b11b-125d5e3dd301 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.318607 May 10 17:22:51.075846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 228/483] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:50 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:51.076467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:51.080781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:51.081774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:51.086432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ef83254f-d142-4090-8c2b-42cb1420b576 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.302313 May 10 17:22:51.087034 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 256/484] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:50 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:51.089277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:51.089917 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:51.090740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:51.091177 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:51.192452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:51.193062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:51.200268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:51.200726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:51.201495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:51.201938 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:51.296598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-23d8fa00-aff4-443b-ae36-11f6f6844ce1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.218818 May 10 17:22:51.297467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 229/485] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:51 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:51.394438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:51.403398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c24f747f-5276-4c34-a616-7edec044677f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.214601 May 10 17:22:51.404002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 257/486] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:51 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:52.092587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:52.093470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:52.101943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.103176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.103520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:52.103933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.104135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:52.104318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.111756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.112209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.112982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.113423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.470723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:52.475271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:52.480403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-49f6415c-bcb1-41fb-80c1-6f6a39158db2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.392106 May 10 17:22:52.480977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 230/487] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:52 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:52.484266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-49fb2a5a-e9d6-4d33-997e-e0d18406a8fd tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.385109 May 10 17:22:52.484903 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 258/488] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:52 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:52.485415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:52.486319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:52.489809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:52.490714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:52.493509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.493963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.494771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.495217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.497866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.498328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.499140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:52.499589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:52.688826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9ccee4d1-8491-4beb-97d2-1e500d93d975 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.206546 May 10 17:22:52.689487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 231/489] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:52 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:52.695061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:52.703738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dc227771-3233-4828-bcae-85d8479e73e4 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.217408 May 10 17:22:52.704311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 259/490] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:52 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:53.497970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:53.498744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:53.500932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:53.501552 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:53.506670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.507131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.507926 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.508388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.508834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.509293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.510082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.510559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.783596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:53.792189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b59d0171-c7a1-4a9a-ae8c-014fd06e0496 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.295137 May 10 17:22:53.792750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 260/491] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:53 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:53.797162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:53.798155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:53.803304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:53.805145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.805600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.806511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.806954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.812249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1af46cb2-feb5-47cf-ba3a-1efdeeb3d0e3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.319149 May 10 17:22:53.812812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 232/492] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:53 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:53.817961 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:53.818756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:53.826405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.826970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.827849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:53.828299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:53.968904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0c4f9c24-4932-4930-81c4-d276723000df tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.174729 May 10 17:22:53.969476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 261/493] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:53 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:54.022849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:54.031235 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8303a1b1-a442-4624-af6c-a0fa51b1d8fc tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.216702 May 10 17:22:54.031804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 233/494] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:53 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:54.809885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:54.810643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:54.818414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:54.818874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:54.819643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:54.820082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:54.828693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:54.829322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:54.837001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:54.837461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:54.838247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:54.838727 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:55.104265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:55.112475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5ced7866-d806-4e0a-ba6b-42b718bb357c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.307267 May 10 17:22:55.113044 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 262/495] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:54 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:55.117649 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:55.119346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:55.124467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:55.126427 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:55.127106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:55.127898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:55.128347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:55.133124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1b56ec95-ebc5-48db-9e04-36ac6331b712 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.308151 May 10 17:22:55.133686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 234/496] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:54 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:55.137956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:55.138606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:55.145408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:55.145861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:55.146663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:55.147106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:55.270496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-629eb120-44fc-4662-b497-0dc108e275f3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.155898 May 10 17:22:55.271168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 263/497] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:55 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:55.347851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:55.357191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e58b1562-52a4-4fc0-b682-6271b7b32183 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.222492 May 10 17:22:55.369283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 235/498] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:55 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:56.130087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:56.130855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:56.139479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.139939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.140722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.141169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.148560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:56.149518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:56.156790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.157249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.158059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.158539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.438162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:56.443558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:56.447852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cd3abe3e-6ae8-4b38-a529-370e6369cad2 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.302889 May 10 17:22:56.448623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 236/499] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:56 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:56.453243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:56.453645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-08222a05-336a-4a9e-8d81-cec06bed85e6 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.327360 May 10 17:22:56.454184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:56.466538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.466538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.466538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.466538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.466884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 264/500] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:56 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:56.468653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:56.469397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:56.477357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.478325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.479165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:56.479858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:56.618387 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ab6bec38-ed6d-48c4-b70e-8983dce9f17a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.168214 May 10 17:22:56.619516 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 237/501] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:56 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:56.680312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:56.688632 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3c9fb3c8-2b20-4008-a695-7f87636ae5dd tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.224153 May 10 17:22:56.689258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 265/502] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:56 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:57.465946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:57.466721 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:57.470042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:57.470712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:57.475446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.475950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.476738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.477177 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.478894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.479361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.480152 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.480598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.785519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:57.788498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:57.793957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0d01c3c0-d608-4257-8db9-bf41891f9dfc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.327592 May 10 17:22:57.794646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 266/503] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:57 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:22:57.799285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:57.800537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:57.800800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-13c171d3-9f6c-4d9c-82b1-ef72d622478e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.339710 May 10 17:22:57.810532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 238/504] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:57 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:57.810532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:57.810532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:57.812963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.813626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.814466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.814928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.815040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.815389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:57.816169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:57.816608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:58.033172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7f0f80c9-6e31-47f7-9f7d-6f455bd3cd36 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.236876 May 10 17:22:58.033816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 267/505] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:57 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:58.152945 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:58.161090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9b86dd60-a6f9-48d3-94af-8edd2f681f02 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.358395 May 10 17:22:58.161687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 239/506] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:57 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:58.657755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5814a1-f82f-4ae5-a5ef-9d12fe30755f", "device": "/dev/sdb"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:58.659443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:58.667428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:58.667885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:58.668664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:58.669099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:58.811021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:58.813086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:58.821043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:58.821530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:58.822400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:58.822912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.017244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:59.025362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-856a6782-c991-4c3b-804b-7436d20b8353 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.217944 May 10 17:22:59.026001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 240/507] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:58 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:59.030262 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:59.030909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:59.037964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.038456 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.039347 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.039750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.060719 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9ddee514-6f59-4463-ae78-9a40e58b618b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "POST /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406875 May 10 17:22:59.061537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 268/508] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:22:58 2021] POST /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:22:59.067623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:59.068795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:59.082890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.083534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.084462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.085110 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.240052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-723ed9e2-3ad3-40a3-8e2f-1a150bbf611b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.176735 May 10 17:22:59.240788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 269/509] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:22:59 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:22:59.245679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:22:59.246410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:22:59.255155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.255617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.256405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.257044 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.331818 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:59.341739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1deed9b5-b3c7-4419-8943-8faaa08236cf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.314687 May 10 17:22:59.343045 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 241/510] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:59 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:59.480167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:22:59.488563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aca04e7b-716f-4fe9-83a3-8c80ba9e713d tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.246698 May 10 17:22:59.489331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 270/511] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:22:59 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:22:59.498430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-c300ec7c-2c8a-45a4-946b-ee5e09a9144d req-ea9e894f-d635-4bf4-abd6-b2bd54064f57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c824b-a74d-4951-80a9-0a37e0c67b95", "name": "network-vif-plugged", "status": "completed", "tag": "f45c4d8b-c6fb-4cff-8ecf-637d4b509510"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:22:59.500040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:22:59.500040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:22:59.509601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c300ec7c-2c8a-45a4-946b-ee5e09a9144d req-ea9e894f-d635-4bf4-abd6-b2bd54064f57 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:22:59.510055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c300ec7c-2c8a-45a4-946b-ee5e09a9144d req-ea9e894f-d635-4bf4-abd6-b2bd54064f57 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:22:59.525978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-c300ec7c-2c8a-45a4-946b-ee5e09a9144d req-ea9e894f-d635-4bf4-abd6-b2bd54064f57 service nova] Creating event network-vif-plugged:f45c4d8b-c6fb-4cff-8ecf-637d4b509510 for instance b04c824b-a74d-4951-80a9-0a37e0c67b95 on hv-cinder-78638 May 10 17:22:59.530671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-c300ec7c-2c8a-45a4-946b-ee5e09a9144d req-ea9e894f-d635-4bf4-abd6-b2bd54064f57 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035882 May 10 17:22:59.531249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 242/512] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:22:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:00.040814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:00.041443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:00.048821 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.049276 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.050048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.050519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.242247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:00.251861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2e74fcb1-88ec-46f7-ba46-f3c70a20eeed tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.214752 May 10 17:23:00.252614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 271/513] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:00 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:00.252725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:00.253870 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:00.261344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.261795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.262605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.263079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.359063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:00.359716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:00.367057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.367521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.369020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.369465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.517505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-09cbc6ee-d3c2-4bb9-8a4e-ac86c449ea0d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.268954 May 10 17:23:00.518479 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 243/514] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:00 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:00.523150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:00.523865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:00.531958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.532423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.533210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:00.533659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:00.565926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:00.574726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9a9d8c7e-5041-48fe-ba56-1f365dcf1d17 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.219308 May 10 17:23:00.575302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 272/515] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:00 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:00.736196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:00.744740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b5524b2a-f419-46c0-bdba-f1324ca7cb8e tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.225394 May 10 17:23:00.745410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 244/516] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:00 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:01.268306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:01.268861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:01.277126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.277581 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.278379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.278824 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.472582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:01.481682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eff1f110-6e7e-426a-bbb4-1e02d13d41ae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.217117 May 10 17:23:01.482253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 273/517] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:01 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:01.529515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:01.530385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:01.538483 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.539297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.540532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.541305 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.545873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-79072ed6-95f6-482e-9f37-f1e831451a44 req-5627681b-16af-4ae1-a592-4427a17f4a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6274f01-93d9-42e0-99ee-a9e40aca8eaf", "name": "network-vif-plugged", "status": "completed", "tag": "e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:01.547542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:01.547542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:23:01.555630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-79072ed6-95f6-482e-9f37-f1e831451a44 req-5627681b-16af-4ae1-a592-4427a17f4a15 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.556080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-79072ed6-95f6-482e-9f37-f1e831451a44 req-5627681b-16af-4ae1-a592-4427a17f4a15 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.571444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-79072ed6-95f6-482e-9f37-f1e831451a44 req-5627681b-16af-4ae1-a592-4427a17f4a15 service nova] Creating event network-vif-plugged:e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d for instance a6274f01-93d9-42e0-99ee-a9e40aca8eaf on hv-cinder-78638 May 10 17:23:01.576217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-79072ed6-95f6-482e-9f37-f1e831451a44 req-5627681b-16af-4ae1-a592-4427a17f4a15 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035019 May 10 17:23:01.576830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 274/518] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:01.592061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:01.592765 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:01.600369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.600825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.601596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.602035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.720011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c93ee7ac-6fdb-432a-b48e-1536c0b225ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 28627 microversion: 2.20 time: 0.194048 May 10 17:23:01.721056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 245/519] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:01 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 28627 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:01.762067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:01.766083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:01.776463 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.777017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.777842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:01.778504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:01.816474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:01.825763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-055f9ca3-1c26-44d6-8f94-be38d51c3ba7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.237578 May 10 17:23:01.826360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 275/520] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:01 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:02.023845 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:02.032555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cd742ffa-3b02-4d0f-90cc-09e83f0c18ad tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.275210 May 10 17:23:02.033311 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 246/521] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:01 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:02.499218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:02.499844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:02.507510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.507966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.509253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.509701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.701774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:02.710307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-285127f8-cf12-49fe-9dd3-b42728a81bde tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1317 microversion: 2.1 time: 0.214825 May 10 17:23:02.711134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 276/522] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:02 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:02.731794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:02.732724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:02.739900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.740353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.741135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.741588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.842858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:02.843473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:02.850891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.851348 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.852126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:02.852576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:02.978589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2f501d81-a9b5-4954-9e85-13cae3e687f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 29538 microversion: 2.20 time: 0.250275 May 10 17:23:02.980148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 247/523] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:02 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 29538 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:03.041682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:03.049565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:03.050539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:03.050659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a9f2387e-8157-44bc-878a-4f8ad5cdcd04 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.211428 May 10 17:23:03.051345 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 277/524] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:02 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:03.059441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:03.060153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:03.061041 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:03.061507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:03.256591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:03.264881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-df93346d-019e-4129-b719-fda1c02726b0 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.219611 May 10 17:23:03.265481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 248/525] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:03 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:03.728579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:03.729276 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:03.736717 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:03.737169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:03.737938 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:03.738406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:03.932851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:03.940991 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fcd4bbfe-abb7-4e7f-960a-53853c7568bc tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1506 microversion: 2.1 time: 0.217431 May 10 17:23:03.941557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 278/526] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:03 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:03.990266 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:03.991298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:03.998599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:03.999060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:03.999853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:04.000291 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:04.068423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:04.069041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:04.076868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:04.077329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:04.078105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:04.078576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:04.187944 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-357ca3ef-6c9e-49d7-be20-719fde54baab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 30889 microversion: 2.20 time: 0.201239 May 10 17:23:04.193009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 249/527] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:03 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 30889 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:04.281931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:04.282679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:04.285842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:04.292007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:04.293039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:04.293997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:04.294623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:04.295068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-33910422-c9a2-4f8a-bd3b-fefd9ad76738 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.230308 May 10 17:23:04.296020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 279/528] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:04 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:04.492020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:04.500903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fd3e6d8e-531c-4034-8e12-ba004c348b56 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1313 microversion: 2.1 time: 0.223145 May 10 17:23:04.501467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 250/529] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:04 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:05.200958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:05.201914 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:05.209167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.209624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.210428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.210878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.312651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:05.313207 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:05.321847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.322313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.323136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.323591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.354441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1e1e1c2d-86f2-4d8b-8af8-dfe2225fc121 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 33963 microversion: 2.20 time: 0.156959 May 10 17:23:05.355231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 280/530] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:05 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 33963 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:05.451511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ca7b5e-5649-4a6f-a7cb-12fc3facf252"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:05.452687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:05.461760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.462219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.463042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.463483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.668502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:05.678194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6c67ef60-155e-45f2-8acc-00d62846f79e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.369461 May 10 17:23:05.678859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 251/531] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:05 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:05.683752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:05.684363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:05.691308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.691772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.692549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:05.692987 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:05.894255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:05.902553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6396b9eb-d494-4394-b85c-70e7e5291cf9 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1497 microversion: 2.1 time: 0.222411 May 10 17:23:05.903171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 252/532] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:05 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1497 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:06.366557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:06.367619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:06.375624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:06.376374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:06.377234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:06.377781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:06.416532 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f17af626-8bba-4fe6-84cf-7977b7f86256 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "POST /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.969777 May 10 17:23:06.418453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 281/533] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:23:05 2021] POST /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95/os-volume_attachments => generated 194 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:06.445623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-260213555", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-547954858", "security_groups": [{"name": "tempest-secgroup-smoke-1907177962"}], "networks": [{"uuid": "2b27b3d6-b96f-40b8-8215-39e706b9c0cf"}], "block_device_mapping_v2": [{"uuid": "9304e5f0-aeab-4d46-afd0-7740d413737e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:06.574751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-58c7fe44-42ab-460a-ac29-d99022fb24aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 34886 microversion: 2.20 time: 0.211821 May 10 17:23:06.576199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 253/534] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:06 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 34886 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:06.636417 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] validate_networks() for [('2b27b3d6-b96f-40b8-8215-39e706b9c0cf', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:23:06.695573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:06.696841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:06.704703 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:06.705165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:06.705943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:06.706412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:06.984545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:06.994172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c36fc462-c1dd-4335-bce7-ce75110c308c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.302764 May 10 17:23:06.994773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 254/535] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:06 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:06.999382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:07.000049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:07.008489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.009129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.010066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.010709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.074943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:07.187828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-69027eb0-f0e7-4d8e-8800-7b81bee2e052 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 204 len: 0 microversion: 2.1 time: 0.191416 May 10 17:23:07.188659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 255/536] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:06 2021] DELETE /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:07.199010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:07.199925 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:07.207342 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.207802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.208593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.209035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.330763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:23:07.331208 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:23:07.331701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:23:07.332164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:23:07.332597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:23:07.342175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.342836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.343666 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.344117 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.361166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:23:07.365225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Getting quotas for user 0e59d19771484ad188993b1bcccba538 and project 3f31dcd80b43441793b8dccf23bea16a. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:23:07.416202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:07.424263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e02c9897-d710-45ce-affb-94830caea2da tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.231512 May 10 17:23:07.424836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 256/537] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:07 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:07.465404 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:23:07.467757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9304e5f0-aeab-4d46-afd0-7740d413737e',volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:23:07.592058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:07.592986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:07.608436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.608893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.609680 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:07.610120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:07.645827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3eaee3d2-6028-4a3d-887f-063d4386a15a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205687 May 10 17:23:07.646687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 282/538] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:23:06 2021] POST /compute/v2.1/servers => generated 406 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:23:07.656500 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c658c6f6-b258-463b-abbe-7ac1b8aa754c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:07.657266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c658c6f6-b258-463b-abbe-7ac1b8aa754c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:07.731224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c658c6f6-b258-463b-abbe-7ac1b8aa754c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:07.739272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c658c6f6-b258-463b-abbe-7ac1b8aa754c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1087 microversion: 2.1 time: 0.086484 May 10 17:23:07.739842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 283/539] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:07 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1087 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:07.824613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-93a186e4-96b1-4e68-9a4c-6f3a2dbc8481 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 35438 microversion: 2.20 time: 0.240874 May 10 17:23:07.825263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 257/540] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:07 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 35438 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:08.011682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:08.012337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:08.020549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.021005 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.021786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.022259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.230553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:08.239374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3fc06c9b-15ed-41f9-a516-5e11759fff83 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1567 microversion: 2.1 time: 0.232183 May 10 17:23:08.239941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 284/541] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:08 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:08.443188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:08.443851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:08.452327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.452781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.453557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.453994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.660676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:08.669544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e6e37a30-27dd-4dd1-92df-b2cf3d8f1ca3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.230601 May 10 17:23:08.670193 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 258/542] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:08 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:08.755867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:08.756490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:08.763644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.764095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.764867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.765308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.836433 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:08.837389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:08.844626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.845077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.845856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:08.846292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:08.880428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:08.889234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9daa9aff-dd93-4c4d-a300-6a0755928b9d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1185 microversion: 2.1 time: 0.137038 May 10 17:23:08.889813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 285/543] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:08 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:09.069650 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cc0ce049-1efc-415b-a3e3-55f50dec080b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 35789 microversion: 2.20 time: 0.236691 May 10 17:23:09.070325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 259/544] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:08 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 35789 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:09.256445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:09.257190 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:09.265952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.266584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.267480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.267994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.474166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:09.483107 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4a372c22-6464-413f-9587-570bafe9b421 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1547 microversion: 2.1 time: 0.230492 May 10 17:23:09.483670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 286/545] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:09 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:09.500152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:09.500716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:09.509135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.509601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.510478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.511074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.671448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] HTTP exception thrown: Cannot 'detach_volume' instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 while it is in vm_state rescued May 10 17:23:09.672409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Returning 409 to user: Cannot 'detach_volume' instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 while it is in vm_state rescued {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:23:09.673257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ba8f8a49-7c2b-4954-8e05-b3a0a0a75cab tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments/7b231bb1-7213-4a38-a361-22f909840848" status: 409 len: 152 microversion: 2.1 time: 0.177530 May 10 17:23:09.673814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 260/546] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:23:09 2021] DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments/7b231bb1-7213-4a38-a361-22f909840848 => generated 152 bytes in 179 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 17:23:09.684222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:09.685452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:09.692410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:09.694254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:09.694988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.695534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.697145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.697816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.708983 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.710285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.711993 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.713000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.875408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f81684c9-5aa8-4dc0-848a-fd311fa92ef4 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action" status: 202 len: 0 microversion: 2.1 time: 0.196695 May 10 17:23:09.876506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 287/547] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:23:09 2021] POST /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:09.885367 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:09.886077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:09.893663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.894308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:09.895071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:09.895543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:10.397426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:10.406083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f76fb6fe-2cb6-40a3-b7d6-9d65e3daa56c tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.722942 May 10 17:23:10.415611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 261/548] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:09 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:10.415611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:10.415611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:10.419251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:10.420038 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:10.420953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:10.421425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:10.458566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:10.467579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-673bc4d7-f818-4f1e-b231-e83807c2294c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.586993 May 10 17:23:10.468646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 288/549] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:09 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:10.473118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:10.474862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:10.482204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:10.482846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:10.483830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:10.484432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:10.554166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:10.562939 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2cdd647-d30f-4045-8ef1-048008113864 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1203 microversion: 2.1 time: 0.155085 May 10 17:23:10.563507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 262/550] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:10 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:11.423318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:11.423979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:11.431883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.432344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:11.433130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.433575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:11.626705 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:11.635787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5a4958ec-d948-4862-9246-dbabb1761217 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.216418 May 10 17:23:11.636360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 263/551] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:11 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:11.640588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:11.641203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:11.648060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.648520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:11.649458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.649907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:11.849909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:11.859217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-886da81d-1b24-485e-bcce-0d05ec6e639a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.221913 May 10 17:23:11.859774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 264/552] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:11 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:11.864028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:11.864632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:11.871917 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.872365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:11.873131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:11.873566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:12.085746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:12.094745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b12b3f0c-2911-4c71-b2ee-9bfe13d8d117 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.233974 May 10 17:23:12.095299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 265/553] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:11 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:12.652981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:12.653616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:12.661293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:12.661751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:12.662570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:12.663018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:12.855085 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:12.863274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1bf1e69a-5650-495a-8551-28245975ff4b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.214561 May 10 17:23:12.863840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 266/554] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:12 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:12.875851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:12.876462 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:12.883277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:12.883733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:12.884507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:12.884950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:13.081428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:13.090611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-166c549f-d33b-4840-a1a6-03deee88b63f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.218044 May 10 17:23:13.091364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 267/555] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:12 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:13.112041 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:13.112661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:13.119684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:13.120140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:13.120918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:13.121356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:13.311177 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:13.319358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5a1e4742-3587-4078-a82a-f6a5651e1033 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.210907 May 10 17:23:13.319950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 268/556] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:13 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:13.880119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:13.880723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:13.888554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:13.889014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:13.889795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:13.890239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:14.083608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:14.092527 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-69fe9e54-2046-4563-8254-83933a950a00 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.216079 May 10 17:23:14.093091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 269/557] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:13 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:14.107100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:14.107714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:14.114663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:14.115119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:14.115899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:14.116340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:14.313404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:14.322684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d8cf4e99-1e25-4316-9ea7-cb680e34cf69 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.218920 May 10 17:23:14.323255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 270/558] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:14 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:14.335963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:14.336699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:14.343591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:14.344048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:14.344828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:14.345271 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:14.602848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:14.611043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a9c7e057-3066-49ad-8ca2-e801c1343ec1 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.278471 May 10 17:23:14.611611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 271/559] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:14 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:14.933494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c3407ee8-2a39-4707-b676-b410053cbec8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 38086 microversion: 2.20 time: 4.463475 May 10 17:23:14.938292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 289/560] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:10 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 38086 bytes in 4466 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:15.109210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:15.109835 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:15.116967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.117417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.118240 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.118706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.340441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:15.341168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:15.349630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.350092 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.350918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.351426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.667779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:15.676565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bb2dc1e0-6e6b-4c7d-bf9f-eb4628836260 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1503 microversion: 2.1 time: 0.570941 May 10 17:23:15.686053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 272/561] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:15 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:15.690956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:15.691708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:15.699514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.700117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.700984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:15.701549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:15.961311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:15.970767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-640ddb79-7fed-48e5-ba52-5262400659b6 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.635075 May 10 17:23:15.976088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 290/562] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:15 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:15.977918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:15.992233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:16.002568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.004451 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.005509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.006250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.249235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-be796f5b-f12d-4292-b385-2febe58082f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 38156 microversion: 2.20 time: 0.275671 May 10 17:23:16.249867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 291/563] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:15 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 38156 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:16.475029 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:16.484616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-50201cbf-fd36-4954-aa52-02dc714260c0 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.797359 May 10 17:23:16.485225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 273/564] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:15 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:16.657004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-99056847-82cb-49e5-b274-a470c4579e7b req-7815ea01-f40d-4950-bfe4-70ca4098f751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6274f01-93d9-42e0-99ee-a9e40aca8eaf", "name": "network-vif-deleted", "tag": "e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:16.658887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:16.658887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:23:16.668160 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-99056847-82cb-49e5-b274-a470c4579e7b req-7815ea01-f40d-4950-bfe4-70ca4098f751 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.668791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-99056847-82cb-49e5-b274-a470c4579e7b req-7815ea01-f40d-4950-bfe4-70ca4098f751 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.688986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-99056847-82cb-49e5-b274-a470c4579e7b req-7815ea01-f40d-4950-bfe4-70ca4098f751 service nova] Creating event network-vif-deleted:e9cf3f8a-41df-4914-b5e5-4e80c8cc3e8d for instance a6274f01-93d9-42e0-99ee-a9e40aca8eaf on hv-cinder-78638 May 10 17:23:16.693902 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:16.694613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:16.705322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.705779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.705958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-99056847-82cb-49e5-b274-a470c4579e7b req-7815ea01-f40d-4950-bfe4-70ca4098f751 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053024 May 10 17:23:16.706646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.707645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.709232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 292/565] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:16.716202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-099454fa-f838-4c7d-8272-55a70a8eaa3d req-33b53b92-1e8f-47fc-a616-b12e5b22b9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:16.717693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:16.717693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:23:16.727497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-099454fa-f838-4c7d-8272-55a70a8eaa3d req-33b53b92-1e8f-47fc-a616-b12e5b22b9e5 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.727962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-099454fa-f838-4c7d-8272-55a70a8eaa3d req-33b53b92-1e8f-47fc-a616-b12e5b22b9e5 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.745091 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-099454fa-f838-4c7d-8272-55a70a8eaa3d req-33b53b92-1e8f-47fc-a616-b12e5b22b9e5 service nova] Creating event network-changed:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:23:16.749687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-099454fa-f838-4c7d-8272-55a70a8eaa3d req-33b53b92-1e8f-47fc-a616-b12e5b22b9e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038298 May 10 17:23:16.750636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 293/566] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:23:16.828633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:16.837191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2a6db8c5-1987-425e-85e2-63d6a5c12865 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1461 microversion: 2.1 time: 0.146826 May 10 17:23:16.837759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 274/567] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:16 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1461 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:16.989516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:16.990157 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:16.998315 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:16.998803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:16.999588 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.000038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.190713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:17.199309 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7924d467-ed41-4112-a93f-81146b7fb17a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.214050 May 10 17:23:17.199874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 294/568] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:16 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:17.260920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:17.261919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:17.269345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.269803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.270618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.271063 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.501446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:17.502070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:17.509818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.510275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.511097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.511535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.710408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:17.719194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0c5660e0-0494-4ec3-b925-4e0a74b6b720 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.221645 May 10 17:23:17.719757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 295/569] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:17 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:17.854475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:17.855086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:17.862193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.862707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.863475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:17.863915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:17.977283 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:17.985767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b370772a-86e8-4c9a-ae40-439adf13dee3 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1461 microversion: 2.1 time: 0.134784 May 10 17:23:17.986329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 296/570] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:17 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1461 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:18.216512 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:18.218142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:18.226088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:18.226698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:18.228357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:18.228934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:18.428979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:18.438658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d7974d01-6595-4748-9cfe-5aa7cbdf022f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.226112 May 10 17:23:18.439312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 297/571] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:18 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:18.736064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:18.736695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:18.743937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:18.744395 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:18.745179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:18.745623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:18.933221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:18.941400 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-12c06cc1-7eb0-4369-ab12-aa1130a60537 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.209177 May 10 17:23:18.941970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 298/572] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:18 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:19.002993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:19.003728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:19.011710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.012276 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:19.013189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.013754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:19.129460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:19.138107 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9556df4a-1614-4485-a126-3d9abcdb2cc8 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1461 microversion: 2.1 time: 0.138835 May 10 17:23:19.138659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 299/573] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:18 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1461 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:19.454739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:19.455369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:19.462557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.463010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:19.463780 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.464218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:19.656139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:19.664950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a530f561-6613-45c7-9650-d63bbf91c113 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.213990 May 10 17:23:19.665528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 300/574] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:19 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:19.957918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:19.958575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:19.966986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.967390 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:19.968167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:19.968613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:20.174644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:20.182690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-969d5b5b-e75c-470a-ad2f-35427344e1c8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.228457 May 10 17:23:20.183252 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 301/575] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:19 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:20.187570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:20.188176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:20.194858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:20.195307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:20.196231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:20.196669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:20.309613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:20.317720 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-854e771b-f190-4e99-b638-6960c1d4a699 tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1461 microversion: 2.1 time: 0.133514 May 10 17:23:20.318316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 302/576] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:20 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1461 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:20.682364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:20.682998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:20.690333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:20.690818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:20.691602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:20.692046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:20.886706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:20.895494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-87086b1c-76d0-48ff-94ee-cb4afb1565ba tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.217414 May 10 17:23:20.896066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 303/577] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:20 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:21.199065 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:21.199691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:21.207042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.207502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:21.208282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.208733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:21.410222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:21.418459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-20f6abe6-a83d-48f0-9db7-d03621b4365f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.223071 May 10 17:23:21.419032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 304/578] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:21 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:21.424133 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:21.424739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:21.431633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.432085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:21.434463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.435382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:21.553704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e39c8835b96944e780c5b462d7c93a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74edb2011cde4bfcb01eceaf97474332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:21.561790 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ff67c6dc-1bb8-472e-84b5-6d59a254d58b tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 200 len: 1461 microversion: 2.1 time: 0.141048 May 10 17:23:21.562359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 305/579] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:21 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 1461 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:21.693206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-01f248c4-6c64-4b44-b358-dd4f9e294b76 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 38156 microversion: 2.20 time: 4.435598 May 10 17:23:21.693910 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 275/580] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:17 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 38156 bytes in 4437 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:21.912902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:21.913613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:21.921594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.922053 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:21.922874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:21.923317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.297989 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:22.306660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9814496e-d4b7-4f1c-95cf-d3eb729db432 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.397348 May 10 17:23:22.307173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 306/581] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:21 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:22.437416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:22.438924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:22.448867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.449329 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.450122 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.450599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.579491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:22.580029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] [instance: a6274f01-93d9-42e0-99ee-a9e40aca8eaf] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:22.587776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.588234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.589019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.589464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.639763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] HTTP exception thrown: Instance a6274f01-93d9-42e0-99ee-a9e40aca8eaf could not be found. May 10 17:23:22.640379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] Returning 404 to user: Instance a6274f01-93d9-42e0-99ee-a9e40aca8eaf could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:23:22.641227 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ca517741-c840-4790-a0b3-435ed796522f tempest-VolumesActionsTest-1108245166 tempest-VolumesActionsTest-1108245166-project] 10.222.0.32 "GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf" status: 404 len: 111 microversion: 2.1 time: 0.065732 May 10 17:23:22.642126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 307/582] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:22 2021] GET /compute/v2.1/servers/a6274f01-93d9-42e0-99ee-a9e40aca8eaf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:23:22.705646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:22.706911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:22.716560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.717356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.718533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:22.719271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:22.810979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:22.819323 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8a6137d8-aa1a-4d42-a4e8-ea0b1b70e916 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.386759 May 10 17:23:22.820138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 276/583] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:22 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:23.176725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dd4bc3ea-57d0-4477-a796-c5694613adcf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 200 len: 38299 microversion: 2.20 time: 0.474519 May 10 17:23:23.177445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 308/584] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:22 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 38299 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:23.187853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:23.188298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:23.196331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.196905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.197725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.198152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.268709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-68fb132a-442c-4161-8120-8003aa446d5a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/ips" status: 200 len: 151 microversion: 2.20 time: 0.084456 May 10 17:23:23.269454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 277/585] 10.222.0.32 () {60 vars in 1289 bytes} [Mon May 10 17:23:23 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/ips => generated 151 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:23:23.324769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:23.325478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:23.333431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.333884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.334693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.335322 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.404531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:23.407654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:23.418464 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.419264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.420090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.420583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.558999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:23.567929 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f89729df-6039-4ad9-b41f-b94a59e39564 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.247990 May 10 17:23:23.568502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 309/586] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:23 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:23.837458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:23.840636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:23.854891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.855541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.856409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:23.856861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:23.929490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'services' on Instance uuid b04c824b-a74d-4951-80a9-0a37e0c67b95 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:24.091588 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:24.102294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-47bafba7-758d-42a2-82c4-ec417ee2e71a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1271 microversion: 2.1 time: 0.269623 May 10 17:23:24.107032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 310/587] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:23 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1271 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:24.240131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c28627c1-f0fa-4296-be27-664eaf40ceae tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95/os-volume_attachments/e7ca7b5e-5649-4a6f-a7cb-12fc3facf252" status: 202 len: 0 microversion: 2.1 time: 0.843576 May 10 17:23:24.241089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 278/588] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:23:23 2021] DELETE /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95/os-volume_attachments/e7ca7b5e-5649-4a6f-a7cb-12fc3facf252 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:23:24.583721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:24.584372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:24.592188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:24.592645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:24.593434 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:24.593882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:24.799923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:24.808755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d64bcee3-8f40-41e8-ba74-677a60309e10 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.228612 May 10 17:23:24.809385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 311/589] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:24 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:25.123824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:25.124533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:25.132585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:25.132585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:25.133725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:25.134164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:25.333234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:25.342428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4ff12c15-88aa-4715-a451-d3dd7aae405a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.222688 May 10 17:23:25.343070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 279/590] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:25 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:25.824798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:25.825446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:25.832698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:25.833158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:25.833936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:25.834411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:26.028780 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:26.037644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dcbc2a00-4241-4c78-9662-17c0c494151b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.216545 May 10 17:23:26.038601 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 312/591] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:25 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:26.359197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:26.359811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:26.367426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:26.367882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:26.368652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:26.369093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:26.564274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:26.573022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6e618c06-3030-4ff6-bda4-46944afc6461 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.217511 May 10 17:23:26.573591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 280/592] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:26 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:27.054735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:27.055873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:27.063565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:27.064025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:27.064803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:27.065251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:27.255124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:27.263757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54524aaf-8b6c-4fbe-bc68-f1aa3f5ccf9b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.212727 May 10 17:23:27.264328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 313/593] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:27 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:27.589039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:27.589752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:27.597053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:27.597512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:27.598297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:27.598775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:27.863660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:27.871867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4141bb16-bb57-4992-a67a-a480d345d06d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.286552 May 10 17:23:27.872429 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 281/594] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:27 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:28.280681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:28.281299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:28.288783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:28.289233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:28.290007 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:28.290469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:28.486721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:28.495939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3bdb74c3-2231-4399-ab7a-6bf9c0462207 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.218967 May 10 17:23:28.496508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 314/595] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:28 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:28.888540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:28.889170 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:28.896566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:28.897465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:28.897793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:28.898241 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:29.091817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:29.100351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ef59463a-d369-4330-901c-7f5888763c83 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.215535 May 10 17:23:29.100911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 282/596] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:28 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:29.512458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:29.513080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:29.520440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:29.520897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:29.521677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:29.522121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:29.714969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:29.723691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8df74ec7-58b5-44f4-a887-f16409693bd8 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.215424 May 10 17:23:29.724258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 315/597] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:29 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:30.117485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:30.118108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:30.125562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:30.126017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:30.126824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:30.127271 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:30.319931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:30.328575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9d5ce42d-3d94-4884-bd58-935765f3b1a4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.214857 May 10 17:23:30.329137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 283/598] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:30 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:30.741266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:30.741890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:30.749192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:30.749654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:30.750462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:30.750912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:30.942830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:30.952016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aed4e5cc-a983-4df1-8936-1cd145390b65 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.214509 May 10 17:23:30.952583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 316/599] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:30 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:31.345448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:31.346072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:31.353989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.354489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:31.355273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.355717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:31.550417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:31.558971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e2fb94ab-01de-4bd0-b604-0ac1033d5f40 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.217488 May 10 17:23:31.559534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 284/600] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:31 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:31.615237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:31.615776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:31.624221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.624673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:31.625444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.625884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:31.680654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lazy-loading 'flavor' on Instance uuid 9ac86cf8-f933-474a-9e63-aef9cd2041d0 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:31.969499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:31.970287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:31.978821 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.979354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:31.994713 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:31.995232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:32.157729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-48be67a6-7f95-4b2d-b41f-bc6e5f17eaa1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 202 len: 0 microversion: 2.20 time: 0.545724 May 10 17:23:32.158557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 317/601] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:23:31 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:32.168148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:32.170691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:32.179455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:32.179879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:32.180672 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:32.181120 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:32.217897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:32.227446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c847e39e-d8fa-4fed-838b-e8fa076ca72c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.261596 May 10 17:23:32.228002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 285/602] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:31 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:32.382302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:32.391106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:32.392634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:32.393765 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b2030ed5-e4c1-4e96-863a-2c3e6f5423ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.230829 May 10 17:23:32.394324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 318/603] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:32 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:32.575745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:32.576382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:32.583749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:32.584210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:32.584997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:32.585471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:32.783766 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:32.792401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6885898f-e1b8-4f17-bc44-3c4070f7d400 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.220372 May 10 17:23:32.792960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 286/604] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:32 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:33.244227 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:33.244848 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:33.252111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.252564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:33.253331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.253769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:33.412342 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:33.413027 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:33.421243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.421696 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:33.422514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.422953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:33.453420 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:33.462049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5880dc92-ee64-4dcb-be16-0af9b48a9061 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.221652 May 10 17:23:33.462645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 319/605] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:33 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:33.614190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:33.623554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:33.625076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:33.626212 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b82c9cb6-cd84-4ad2-87bb-a05e407d75d2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.217637 May 10 17:23:33.626811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 287/606] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:33 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:33.808769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:33.809391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:33.816791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.817246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:33.818023 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:33.818495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:34.012260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:34.020474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a172bc4b-96df-4be0-85ca-b7674c81fd68 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.215401 May 10 17:23:34.021040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 320/607] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:33 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:34.479339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:34.479970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:34.487307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:34.487769 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:34.488553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:34.489001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:34.644368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:34.644988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:34.652314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:34.652769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:34.653548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:34.653993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:34.690769 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:34.700217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fd9c972b-c222-4c0d-8f45-7592bbbbadee tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.224565 May 10 17:23:34.700780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 288/608] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:34 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:34.849980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:34.858630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:34.860148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:34.861271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-98c81e6b-d210-4b7e-bd65-1d5c0e9a7542 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.220713 May 10 17:23:34.861830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 321/609] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:34 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:35.038682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:35.039227 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:35.052453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.052932 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.053713 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.054148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.250438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:35.259485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c72f8153-0794-4527-8feb-cdc07b994ce2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.224481 May 10 17:23:35.260236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 289/610] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:35 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:35.718098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:35.718743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:35.726064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.726559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.727330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.727774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.879030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:35.879647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:35.887470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.887919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.888691 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:35.889130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:35.923633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:35.932799 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b6caf469-d23f-41a0-960d-84859b07c266 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.218802 May 10 17:23:35.933499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 322/611] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:35 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:36.144168 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:36.153275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:36.154880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:36.156028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8e55b0a1-6247-49ff-a02b-599051609252 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.280706 May 10 17:23:36.156589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 290/612] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:35 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:36.275941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:36.276583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:36.283776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:36.284211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:36.284989 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:36.285437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:36.477521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:36.485655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7e9b76d5-c97f-4df4-984c-a740cd385062 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.213387 May 10 17:23:36.486236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 323/613] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:36 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:36.948808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:36.949421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:36.956689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:36.957137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:36.957905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:36.958360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:37.158839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:37.168096 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-46d27cc5-8960-43bc-8ba2-20ef8815fb5f tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.222347 May 10 17:23:37.168096 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 291/614] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:36 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:37.174042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:37.174728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:37.181951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:37.182445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:37.183228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:37.183673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:37.373389 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:37.382088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:37.384259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:37.385393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-be3da233-26bb-435a-a694-7c957baa0547 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.215178 May 10 17:23:37.385948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 324/615] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:37 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:37.502775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:37.503423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:37.511248 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:37.511704 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:37.512475 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:37.512913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:37.703324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:37.711813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a747d2d2-88a2-4bc4-95e6-7c177bf155ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.212748 May 10 17:23:37.712389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 292/616] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:37 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:38.184197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:38.184827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:38.192586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.193046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.193880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.194321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.389927 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:38.398883 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b19b037c-b747-49a9-b1e1-e12c996d3cb3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1555 microversion: 2.1 time: 0.218386 May 10 17:23:38.399445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 325/617] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:38 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:38.402648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:38.403274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:38.410474 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.410935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.411717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.412163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.623205 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:38.631879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:38.633950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:38.635158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-933a3f1f-74eb-43de-bb8b-c719cbbf5cfa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.236240 May 10 17:23:38.635720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 293/618] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:38 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:38.728704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:38.729345 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:38.736576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.737032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.737808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:38.738253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:38.942043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:38.951181 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4f3d3aad-70d9-402a-b01c-028b558a05d9 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.226552 May 10 17:23:38.951756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 326/619] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:38 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:39.414801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:39.415522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:39.423147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.423614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.424399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.424847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.624144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:39.635522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c073885a-da6a-4e93-89e2-9f0c0ab7ae70 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1561 microversion: 2.1 time: 0.224481 May 10 17:23:39.636445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 294/620] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:39 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:39.652810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:39.653453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:39.662546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.663007 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.663807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.664260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.793580 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:39.794170 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:39.802680 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.803144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.804383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.805362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.869047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:39.878587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:39.880580 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:39.883564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f834d03d-9763-43a4-abdb-c8bc92211876 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.233663 May 10 17:23:39.884602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 327/621] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:39 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:39.969020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:39.969891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:39.972707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'services' on Instance uuid 568c5267-2f2c-4d3b-8364-a05c2b8192b1 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:39.988237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.988709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:39.989636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:39.990095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:40.133856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-73e87981-2d7a-4755-99ec-22cffcec8375 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments/7b231bb1-7213-4a38-a361-22f909840848" status: 202 len: 0 microversion: 2.1 time: 0.343878 May 10 17:23:40.138452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 295/622] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:23:39 2021] DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1/os-volume_attachments/7b231bb1-7213-4a38-a361-22f909840848 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:40.225158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:40.235592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-af82e32f-882d-4862-ba64-9830d48f2412 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.271111 May 10 17:23:40.236440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 328/623] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:39 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:40.902745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:40.904232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:40.914238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:40.914739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:40.915554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:40.915999 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:41.185737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:41.199252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:41.201042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:41.211226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-85ba7f2d-1402-48e3-8471-bdaaffe8e689 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.313054 May 10 17:23:41.211816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 296/624] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:40 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:41.252720 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:41.253965 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:41.263654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:41.264637 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:41.265579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:41.266182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:41.476284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:41.485544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-efa2b613-283c-4d2d-8d59-a11a2fd64853 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.236480 May 10 17:23:41.495396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 329/625] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:41 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:42.230640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:42.231370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:42.238833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.239472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.240501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.240940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.451957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:42.452494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:42.462414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.462880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.463651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:42.463820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.464101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.474932 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:42.476651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:42.478035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c48a5316-0d6e-40fe-bb8d-9acea4cb0d65 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.252062 May 10 17:23:42.479169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 297/626] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:42 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:42.518298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:42.519172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:42.528404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.528967 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.529876 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:42.530576 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:42.712079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lazy-loading 'services' on Instance uuid e932c1fd-4400-4eee-87e0-653b3de9b593 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:42.892245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:42.904292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a76d910e-8199-4d07-b64e-a54bfa458bac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.392573 May 10 17:23:42.915606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 298/627] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:42 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:42.923962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a13d8b81-16c0-4f15-97dc-92a7091b6411 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593/os-volume_attachments/dd5814a1-f82f-4ae5-a5ef-9d12fe30755f" status: 202 len: 0 microversion: 2.1 time: 0.476070 May 10 17:23:42.924680 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 330/628] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:23:42 2021] DELETE /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593/os-volume_attachments/dd5814a1-f82f-4ae5-a5ef-9d12fe30755f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:23:43.369045 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:43.370487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:43.385390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.386157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:43.387246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.387900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:43.496300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:43.498311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:43.505220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:43.518882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.520151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:43.522947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.525887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:43.778371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-83f7af4b-4d02-4998-a9aa-f5ea74473348 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 204 len: 0 microversion: 2.1 time: 0.413457 May 10 17:23:43.781169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 299/629] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:43 2021] DELETE /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:23:43.791720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:43.792747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:43.804841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.805553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:43.806542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:43.807140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:44.253156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:44.276151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:44.281256 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:44.284292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-72b60a1d-75fa-4df7-94b0-d34789802fa8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.792215 May 10 17:23:44.295070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 331/630] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:43 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:44.300928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:44.301760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:44.310216 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:44.311009 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:44.311931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:44.312958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:44.389802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:44.398867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a94b2ea2-e02d-4125-86df-b96437503b63 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1512 microversion: 2.1 time: 0.612140 May 10 17:23:44.399448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 300/631] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:43 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:44.408196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-f648b464-d313-4b48-80c8-9248ede6c042 req-33a4c393-aac1-4ace-a0b4-14cb1134f0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "name": "network-vif-plugged", "status": "completed", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:44.410132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:44.410132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:23:44.419519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f648b464-d313-4b48-80c8-9248ede6c042 req-33a4c393-aac1-4ace-a0b4-14cb1134f0a4 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:44.419995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f648b464-d313-4b48-80c8-9248ede6c042 req-33a4c393-aac1-4ace-a0b4-14cb1134f0a4 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:44.435930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-f648b464-d313-4b48-80c8-9248ede6c042 req-33a4c393-aac1-4ace-a0b4-14cb1134f0a4 service nova] Creating event network-vif-plugged:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:23:44.441003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-f648b464-d313-4b48-80c8-9248ede6c042 req-33a4c393-aac1-4ace-a0b4-14cb1134f0a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037293 May 10 17:23:44.441614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 301/632] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:23:44.533919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:44.542837 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6f2f40b5-24ff-42ab-bd05-bd004d2e553c tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.246485 May 10 17:23:44.543408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 332/633] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:44 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:45.233254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.234546 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.244343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.245295 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.246524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.247311 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.306821 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.308290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.317041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.317792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.318945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.319613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.337208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:45.510613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-385bc4a3-f038-4713-a23e-a824974d13ce tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 204 len: 0 microversion: 2.1 time: 0.281456 May 10 17:23:45.514935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 302/634] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:45 2021] DELETE /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:45.520666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.521463 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.533800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.534559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.535857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.536591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.578172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:45.589681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:45.591488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:45.592843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-211f5fdf-369f-41f7-adfc-bfceb3e3d864 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.291431 May 10 17:23:45.593949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 333/635] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:45 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:45.598956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.599926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.607544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.608666 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.609687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.610323 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.693843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:45.823842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:45.839240 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-916dd749-ffc6-425a-a738-5cbf531ff66c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1512 microversion: 2.1 time: 0.322816 May 10 17:23:45.839905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 303/636] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:45 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:45.853903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.854618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.857546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-56e2f185-9cd1-42d1-bbc5-fd6301ca33ec tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 204 len: 0 microversion: 2.1 time: 0.261933 May 10 17:23:45.861367 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 334/637] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:45 2021] DELETE /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:45.863398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:45.864340 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:45.865987 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.866553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.868332 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.868415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.873737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.874187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:45.875017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:45.875464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.200297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.209984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-327982bf-d503-4994-be2d-59b0ca21dac3 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.360674 May 10 17:23:46.210836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 304/638] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:45 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:46.220416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.224854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:46.225489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:46.234157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.234667 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.235573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.236022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.236473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fcc7df95-7e97-413a-b505-637c6c33aaa3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.376924 May 10 17:23:46.237495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 335/639] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:45 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:46.443598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.452839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-28f08da3-0a3d-4580-b8f4-51b59fc38289 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1512 microversion: 2.1 time: 0.231803 May 10 17:23:46.464274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 305/640] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:46 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:46.613566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:46.614319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:46.623592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.624122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.624995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.625541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.862158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.864025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:46.867136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:46.879950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.883542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:46.885233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7015bd3b-6705-44ee-a20f-ee3454c9d8bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.277350 May 10 17:23:46.886189 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.887014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.887881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:46.888466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:46.896549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 336/641] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:46 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:47.228953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:47.229803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:47.230319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:47.239690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.240332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.241064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.241518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.246561 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-495c4ae3-8109-4247-8b17-933c571c4746 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1512 microversion: 2.1 time: 0.393222 May 10 17:23:47.248386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 306/642] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:46 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:47.261949 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:47.263740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:47.274280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.275023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.276136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.276696 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.613587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:47.618250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:47.630021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0a18ba0d-3198-427b-9f4b-1f371b7686e9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.405714 May 10 17:23:47.630471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1c5eb9be-a5ec-40e1-b699-c72bf243a107 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1259 microversion: 2.1 time: 0.373058 May 10 17:23:47.642047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 337/643] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:47 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:47.642047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:47.642047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:47.642542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 307/644] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:47 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1259 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:47.648402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.648866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.649661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.650108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.879136 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:47.892726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-049d2ed7-d8f4-438a-abea-69e2310a8b44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1512 microversion: 2.1 time: 0.259931 May 10 17:23:47.902895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 338/645] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:47 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:47.908337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:47.909524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:47.918423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.918898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:47.919688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:47.920130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.154856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:48.164936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:48.166500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:48.167680 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-02521b37-313b-4fa7-b3e5-060d2b3a22f2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.263108 May 10 17:23:48.170378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 308/646] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:47 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:48.266903 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:48.268484 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:48.282032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.282676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.283853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.284413 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.550678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:48.563454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-70fb73ac-8bf1-429a-9fe2-2bf489721083 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1512 microversion: 2.1 time: 0.301232 May 10 17:23:48.575617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 339/647] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:48 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:48.651216 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:48.651216 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:48.652046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:48.652452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:48.660498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.663133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.664960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.665447 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.667613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.668083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.668901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:48.669353 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:48.989533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:49.003441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fd4d7eb5-7882-4f4e-a35f-3526e633cd5a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1443 microversion: 2.1 time: 0.356058 May 10 17:23:49.014490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 309/648] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:48 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1443 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:49.016012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:49.022202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:49.025846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:49.030097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f8eb9390-ddb6-46ee-a445-a13244fedb11 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.384636 May 10 17:23:49.041719 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 340/649] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:48 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:49.047862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.054952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:49.055382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.055800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:49.057041 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.057525 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.070975 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.071675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.072582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.073107 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.511148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:49.521549 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-28be5e5b-149c-4115-bbb3-9e45294b8944 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1512 microversion: 2.1 time: 0.509617 May 10 17:23:49.522546 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 310/650] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:49 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1512 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:49.528765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:49.529454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:49.537534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.538257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.539994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.540568 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.547980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:49.557127 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d5702ce5-12bd-4f72-9cd4-6a993b89ef1b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1443 microversion: 2.1 time: 0.513077 May 10 17:23:49.564104 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 341/651] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:49 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1443 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:49.581901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:49.582594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:49.593261 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.596432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:49.596758 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:49.598028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.075339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:50.084423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:50.085913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:50.087094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-14e04028-15ff-4e89-a827-d5c392afa53c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.562602 May 10 17:23:50.087647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 311/652] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:49 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:50.117790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:50.127077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:50.149489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:50.150292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.151287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:50.151887 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.384223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:50.393993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ef516a84-b935-4862-9d13-06e560df7091 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1512 microversion: 2.1 time: 0.816072 May 10 17:23:50.410481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 342/653] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:49 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1512 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:50.539570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:50.540392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:50.547971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:50.548557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.549447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:50.550018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.562774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:50.578481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4e988615-2cad-437f-8125-80560ec91feb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.489574 May 10 17:23:50.579266 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 312/654] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:50 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:50.843822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-8e79e8ed-999a-49f1-836d-91d92276125d req-f9d58836-a6df-4df2-b741-c924037d44d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04c824b-a74d-4951-80a9-0a37e0c67b95", "name": "network-vif-deleted", "tag": "f45c4d8b-c6fb-4cff-8ecf-637d4b509510"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:50.852589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:50.852589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:23:50.868896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8e79e8ed-999a-49f1-836d-91d92276125d req-f9d58836-a6df-4df2-b741-c924037d44d6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:50.869351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8e79e8ed-999a-49f1-836d-91d92276125d req-f9d58836-a6df-4df2-b741-c924037d44d6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:50.911808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-8e79e8ed-999a-49f1-836d-91d92276125d req-f9d58836-a6df-4df2-b741-c924037d44d6 service nova] Creating event network-vif-deleted:f45c4d8b-c6fb-4cff-8ecf-637d4b509510 for instance b04c824b-a74d-4951-80a9-0a37e0c67b95 on hv-cinder-78638 May 10 17:23:50.938578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-8e79e8ed-999a-49f1-836d-91d92276125d req-f9d58836-a6df-4df2-b741-c924037d44d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098879 May 10 17:23:50.945243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 313/655] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:51.024041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:51.051379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-69126025-c8b5-4df0-93ec-243e74d694a3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1512 microversion: 2.1 time: 0.515533 May 10 17:23:51.056439 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 343/656] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:50 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:51.106962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:51.107795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:51.121545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.122007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.122911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.123353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.396762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:51.407554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:51.409933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:51.410590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1c108a5c-b155-4309-8bb1-7ac46c70ec26 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.307847 May 10 17:23:51.416148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:51.416781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:51.423224 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 314/657] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:51 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:51.426226 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.426753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.427551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.435279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.554921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.555423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.556231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'fault' on Instance uuid b04c824b-a74d-4951-80a9-0a37e0c67b95 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:51.596095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:51.597230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:51.612490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.613342 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.614418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:51.615094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:51.745150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:51.772944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b3cf49fb-5cd6-4531-997c-f8f14f9244e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 200 len: 1307 microversion: 2.1 time: 0.356052 May 10 17:23:51.773676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 344/658] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:51 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 1307 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:52.073736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:52.074221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:52.092876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.093578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.094705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.095602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.162184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:52.174599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2fd8972-c5e3-42cc-837d-7a96a62beb5b tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.583318 May 10 17:23:52.175700 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 315/659] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:51 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:52.430780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:52.433888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:52.448764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.449227 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.450025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.450511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.498970 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:52.511708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a32ef5a8-82cf-4bf9-8be0-f701e56ed37b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1512 microversion: 2.1 time: 0.442645 May 10 17:23:52.522670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 345/660] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:52 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1512 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:52.795476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:52.796279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b04c824b-a74d-4951-80a9-0a37e0c67b95] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:52.818054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.818054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.818555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.819244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.930620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Instance b04c824b-a74d-4951-80a9-0a37e0c67b95 could not be found. May 10 17:23:52.931248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 404 to user: Instance b04c824b-a74d-4951-80a9-0a37e0c67b95 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:23:52.932105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cc8f6e53-104a-488d-8cc8-32bbb763251d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95" status: 404 len: 111 microversion: 2.1 time: 0.140923 May 10 17:23:52.936218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 346/661] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:52 2021] GET /compute/v2.1/servers/b04c824b-a74d-4951-80a9-0a37e0c67b95 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:23:52.941920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-a5ed2a87-ea26-4352-9e81-1a42f23a145a req-736a2a60-7679-4f96-aa85-0cd1eff5ec6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e932c1fd-4400-4eee-87e0-653b3de9b593", "name": "network-vif-deleted", "tag": "e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:52.943826 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:52.943826 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:23:52.952801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-a5ed2a87-ea26-4352-9e81-1a42f23a145a req-736a2a60-7679-4f96-aa85-0cd1eff5ec6a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:52.953335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-a5ed2a87-ea26-4352-9e81-1a42f23a145a req-736a2a60-7679-4f96-aa85-0cd1eff5ec6a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:52.970665 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-a5ed2a87-ea26-4352-9e81-1a42f23a145a req-736a2a60-7679-4f96-aa85-0cd1eff5ec6a service nova] Creating event network-vif-deleted:e3e2da96-fc58-4fcd-bcac-e3ea41ef3ec6 for instance e932c1fd-4400-4eee-87e0-653b3de9b593 on hv-cinder-78638 May 10 17:23:52.987556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-a5ed2a87-ea26-4352-9e81-1a42f23a145a req-736a2a60-7679-4f96-aa85-0cd1eff5ec6a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046976 May 10 17:23:52.990752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 347/662] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:23:53.077441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:53.097783 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:53.108690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:53.115364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e36d8e89-b957-426a-8dd2-0b567e233040 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.690476 May 10 17:23:53.122032 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 316/663] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:52 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:23:53.192841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:53.194085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:53.207544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:53.208319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:53.209366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:53.209992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:53.528120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:53.529383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:53.539586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:53.540559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:53.541604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:53.542787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:53.654169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:53.662980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aa3060cb-7a43-46f9-9439-7393eb447783 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1507 microversion: 2.1 time: 0.474443 May 10 17:23:53.664090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 348/664] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:53 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:53.665875 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:53.666592 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:53.667265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lazy-loading 'fault' on Instance uuid e932c1fd-4400-4eee-87e0-653b3de9b593 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:53.876009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:53.891759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-19dc256f-1ab9-4d9f-a88b-bafc875a2323 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 200 len: 1309 microversion: 2.1 time: 0.366412 May 10 17:23:53.893421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 317/665] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:53 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:54.139770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:54.140403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:54.153259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.153735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.157629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.158374 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.309524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-c122fe9f-d3d2-433f-8af8-4bb97dbb62da req-e2272b96-ee2e-4130-8244-b24abc11b162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca99c621-cf4f-4224-b16f-83b403a4e810", "name": "network-vif-deleted", "tag": "b561183d-3956-4826-8e0f-46690d4b1fa6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:54.311443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:54.311443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:23:54.331080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c122fe9f-d3d2-433f-8af8-4bb97dbb62da req-e2272b96-ee2e-4130-8244-b24abc11b162 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.331717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c122fe9f-d3d2-433f-8af8-4bb97dbb62da req-e2272b96-ee2e-4130-8244-b24abc11b162 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.370699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-c122fe9f-d3d2-433f-8af8-4bb97dbb62da req-e2272b96-ee2e-4130-8244-b24abc11b162 service nova] Creating event network-vif-deleted:b561183d-3956-4826-8e0f-46690d4b1fa6 for instance ca99c621-cf4f-4224-b16f-83b403a4e810 on hv-cinder-78638 May 10 17:23:54.386621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-c122fe9f-d3d2-433f-8af8-4bb97dbb62da req-e2272b96-ee2e-4130-8244-b24abc11b162 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084652 May 10 17:23:54.387769 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 318/666] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:23:54.559896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:54.561829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:54.579664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.585872 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.586992 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.587623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.608015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:54.628029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:54.633599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:54.637956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-382f60ba-fbee-4987-8cb0-e0684f4f49c8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.502120 May 10 17:23:54.642876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 349/667] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:54 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:54.681084 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:54.682476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:54.690751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:54.695964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.696698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.699251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.700074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.874124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:54.874872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:54.875497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'fault' on Instance uuid ca99c621-cf4f-4224-b16f-83b403a4e810 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:23:54.925101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f9d3c585-9531-4c9a-bea8-da90ea6d623c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 204 len: 0 microversion: 2.1 time: 0.373144 May 10 17:23:54.931121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 319/668] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:54 2021] DELETE /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:54.958751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:54.967188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: e932c1fd-4400-4eee-87e0-653b3de9b593] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:55.002563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.003379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.005735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.009346 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.051928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:55.065865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6600a67f-5980-4fc2-a639-ad33c78e4714 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 200 len: 1312 microversion: 2.1 time: 0.388050 May 10 17:23:55.075650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 350/669] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:54 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 1312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:55.075650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:55.075650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:55.086158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.086716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.088178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.089161 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.098578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] HTTP exception thrown: Instance e932c1fd-4400-4eee-87e0-653b3de9b593 could not be found. May 10 17:23:55.099522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Returning 404 to user: Instance e932c1fd-4400-4eee-87e0-653b3de9b593 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:23:55.100949 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c6dc54e9-73db-4b31-928d-87a50d6c0d9a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593" status: 404 len: 111 microversion: 2.1 time: 0.168972 May 10 17:23:55.102657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 320/670] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:54 2021] GET /compute/v2.1/servers/e932c1fd-4400-4eee-87e0-653b3de9b593 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:23:55.127888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-ecfa4981-a1fd-43f5-8272-e14c0f59fc2c req-b3703825-c4b5-405c-a3e4-287518c6b9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:23:55.130263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:23:55.130263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:23:55.146217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ecfa4981-a1fd-43f5-8272-e14c0f59fc2c req-b3703825-c4b5-405c-a3e4-287518c6b9c2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.146736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ecfa4981-a1fd-43f5-8272-e14c0f59fc2c req-b3703825-c4b5-405c-a3e4-287518c6b9c2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.164769 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-ecfa4981-a1fd-43f5-8272-e14c0f59fc2c req-b3703825-c4b5-405c-a3e4-287518c6b9c2 service nova] Creating event network-changed:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:23:55.170441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-ecfa4981-a1fd-43f5-8272-e14c0f59fc2c req-b3703825-c4b5-405c-a3e4-287518c6b9c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066288 May 10 17:23:55.171526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 321/671] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:23:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:23:55.576335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:55.587313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-692372f3-a76e-4d9a-8281-504af4b5d971 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.519136 May 10 17:23:55.597357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 351/672] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:55 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:55.661700 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:55.662509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:55.702767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.704629 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:55.709482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:55.710027 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.084881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:56.086067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: ca99c621-cf4f-4224-b16f-83b403a4e810] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:56.105188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.106027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.107156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.107996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.157503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:56.166940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:56.168552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:56.170052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dd00f03c-a248-4536-98d8-adf344fabc3a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.512743 May 10 17:23:56.181747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 322/673] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:55 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:56.221028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] HTTP exception thrown: Instance ca99c621-cf4f-4224-b16f-83b403a4e810 could not be found. May 10 17:23:56.221749 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Returning 404 to user: Instance ca99c621-cf4f-4224-b16f-83b403a4e810 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:23:56.222843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c3d4bbd7-e9b8-4ada-a052-09695b756098 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810" status: 404 len: 111 microversion: 2.1 time: 0.142718 May 10 17:23:56.223442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 352/674] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:56 2021] GET /compute/v2.1/servers/ca99c621-cf4f-4224-b16f-83b403a4e810 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:23:56.232095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:56.232986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:56.242694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.243292 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.249658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.250209 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.326971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:23:56.473161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6aeffdc0-d425-4507-9b98-128f9e422146 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 204 len: 0 microversion: 2.1 time: 0.244553 May 10 17:23:56.474290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 323/675] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:23:56 2021] DELETE /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:23:56.485831 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:56.486644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:56.495016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.495784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.496783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.497425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.606174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:56.607230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:56.626261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.626891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.627698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:56.628160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:56.842952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:56.852331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1f263c75-01dd-467f-bf91-4149e92e7bfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.373612 May 10 17:23:56.853332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 353/676] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:56 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:56.925097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:56.934556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-157c2f32-479c-41b5-ad49-ea2364ecd669 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.333343 May 10 17:23:56.943732 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 324/677] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:56 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:57.205508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:57.206153 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:57.213913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.214399 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:57.215200 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.215643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:57.432616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:57.447286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:57.449320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:57.450835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-866dced4-96e8-4564-b24c-14fb7beef62f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.254226 May 10 17:23:57.451823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 354/678] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:57 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:57.870457 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:57.871287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:57.879183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.879753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:57.880634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.881152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:57.952306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:57.953636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:57.970643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.972506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:57.975052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:57.976958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:58.168948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:58.180335 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fa051b05-cffb-49c3-893a-ec2847beadfb tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.314186 May 10 17:23:58.191287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 325/679] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:57 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:58.281333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:58.292327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-66c0f08f-abd9-44d1-9e8d-0649d94859a7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.344202 May 10 17:23:58.293215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 355/680] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:57 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:23:58.470128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:58.471039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:58.481279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:58.481918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:58.482896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:58.483452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:58.747904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:58.756976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:58.758793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:58.759970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3e815468-19cd-4be5-b4f9-109b33e8100c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.294774 May 10 17:23:58.760616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 326/681] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:58 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:23:59.198577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:59.199145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:59.207510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.208221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:59.209189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.209801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:59.311558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:59.312788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:59.325712 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.326594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:59.351399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.352535 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:59.443059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:59.454092 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a4f4e48c-d972-4bf1-ad1f-6e6c0dbe3a62 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.259490 May 10 17:23:59.459944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 356/682] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:59 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:59.677740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:23:59.688111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cf87f37e-1c5e-46c7-89eb-e57b774671ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.382101 May 10 17:23:59.688789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 327/683] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:23:59 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:23:59.777956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:23:59.778617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:23:59.786382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.786843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:23:59.787653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:23:59.788082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:00.019025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:00.028802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:00.030629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:00.031832 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fc224d9a-3afb-46af-9682-878ca888d4a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.257688 May 10 17:24:00.049161 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 357/684] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:23:59 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:00.476070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:00.477134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:00.484760 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:00.485217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:00.486195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:00.486686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:00.697328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:00.706239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5a726187-93c9-45a5-b5c9-350f789783d7 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.234043 May 10 17:24:00.706570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:00.707056 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:00.708605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 328/685] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:00 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:00.715398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:00.715866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:00.716677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:00.717126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:00.930583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:00.939052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8bb48aa7-d651-4827-80c9-617585bf51ba tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.236337 May 10 17:24:00.939612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 358/686] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:00 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:01.056111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:01.056745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:01.064269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.064735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:01.065526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.065984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:01.265950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:01.275772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:01.277501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:01.278817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a10594e0-ffe4-41d5-854e-c90d87120403 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.226480 May 10 17:24:01.279420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 329/687] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:01 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:01.723727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:01.724333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:01.732486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.732954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:01.733740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.734191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:01.930516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:01.938778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2d0c855e-0ef6-41c9-90da-f748ddbadf77 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.218735 May 10 17:24:01.939354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 359/688] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:01 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:01.955857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:01.956510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:01.963610 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.964069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:01.964841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:01.965281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:02.162477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:02.171276 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-63f44df1-5a2b-4023-9fe0-4a0110abb326 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.219062 May 10 17:24:02.171846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 330/689] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:01 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:02.298857 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:02.299475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:02.306680 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:02.307138 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:02.307916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:02.308356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:02.502467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:02.511597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:02.513158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:02.514291 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d2151397-8643-400a-9a93-cf64ea58006c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.219189 May 10 17:24:02.514873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 360/690] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:02 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:02.955335 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:02.956001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:02.963279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:02.963731 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:02.964505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:02.964941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:03.156825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:03.165075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a045b0de-ef9c-4873-834a-dfe61db17ef5 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.213456 May 10 17:24:03.165645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 331/691] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:02 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:03.187681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:03.188320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:03.196335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:03.196789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:03.197566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:03.198016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:03.393647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:03.402047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-74a7048a-85cc-472f-a31d-73cf51fbc1bf tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.218151 May 10 17:24:03.402729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 361/692] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:03 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:03.532417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:03.533050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:03.540853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:03.541318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:03.542107 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:03.542586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:03.924847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:03.939394 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:03.940934 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:03.942095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5273c47f-1683-4b8b-bba0-cbf15857580d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.413448 May 10 17:24:03.942686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 332/693] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:03 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:04.182440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:04.183067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:04.190262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.190856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:04.191551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.191998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:04.383379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:04.391576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-66a9341f-9214-4365-9870-63ea8896e84d tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.213794 May 10 17:24:04.392140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 362/694] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:04 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:04.419240 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:04.419896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:04.427084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.427541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:04.428320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.428757 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:04.619920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:04.628265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e63eef4a-4dde-475f-b1d5-9006f52ed2c3 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.212856 May 10 17:24:04.628829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 333/695] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:04 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:04.961331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:04.962078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:04.970905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.970905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:04.970905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:04.970905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:05.252574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:05.264633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:05.266357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:05.267621 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fd769dd7-e667-4671-aa68-ebd4ab963e30 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.310590 May 10 17:24:05.268172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 363/696] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:04 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:05.408772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:05.409391 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:05.416537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:05.416998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:05.417808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:05.418247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:05.617597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:05.626958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-766a2e43-91bb-4817-8cb9-0bf81a22b13a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.222115 May 10 17:24:05.627537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 334/697] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:05 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:05.645566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:05.645998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:05.654074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:05.654729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:05.655620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:05.656174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:05.855091 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:05.864307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bb1a79ca-5387-4c6a-80e5-f4271c8b002d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1514 microversion: 2.1 time: 0.223268 May 10 17:24:05.864888 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 364/698] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:05 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:06.111651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-6693b3a0-b356-4d41-aa85-7f357ea404e3 req-2f350df0-c179-4681-a0be-a5f20a8a7cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "name": "network-vif-plugged", "status": "completed", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:06.113501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:06.113501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:24:06.124693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-6693b3a0-b356-4d41-aa85-7f357ea404e3 req-2f350df0-c179-4681-a0be-a5f20a8a7cc7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.125383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-6693b3a0-b356-4d41-aa85-7f357ea404e3 req-2f350df0-c179-4681-a0be-a5f20a8a7cc7 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.143847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-6693b3a0-b356-4d41-aa85-7f357ea404e3 req-2f350df0-c179-4681-a0be-a5f20a8a7cc7 service nova] Creating event network-vif-plugged:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:24:06.149071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-6693b3a0-b356-4d41-aa85-7f357ea404e3 req-2f350df0-c179-4681-a0be-a5f20a8a7cc7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041029 May 10 17:24:06.150094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 335/699] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:06.288415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:06.289037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:06.296425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.296882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.297674 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.298115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.643565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:06.644322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:06.652402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.652877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.653677 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.654161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.784849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:06.795583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:06.798410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:06.799806 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2328cc6f-0086-4fde-9e3f-8cb0b1519f54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1745 microversion: 2.20 time: 0.516124 May 10 17:24:06.802470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 365/700] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:06 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1745 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:06.888184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:06.889084 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:06.897037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.897497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.899144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:06.899144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:06.959794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:06.985585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dae5450b-5833-48a9-b8cc-3ea66bffa82e tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.346571 May 10 17:24:06.986883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 336/701] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:06 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:07.159422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:07.170078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-702ba520-9d1a-48a5-8066-e19c33efef7e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1472 microversion: 2.1 time: 0.292648 May 10 17:24:07.170887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 366/702] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:06 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:07.182938 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-5f67f28c-e978-4f23-8eff-7e7eb8826958 req-c0558f7d-e73d-4058-9e02-b75715ce4dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c232b4-e9fa-4f10-8db8-cabb373ef0c1", "name": "network-vif-deleted", "tag": "1bd6f1d7-5140-47ca-a79d-6899fb7d7339"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:07.185687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:07.185687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:24:07.199793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-5f67f28c-e978-4f23-8eff-7e7eb8826958 req-c0558f7d-e73d-4058-9e02-b75715ce4dc6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:07.200358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-5f67f28c-e978-4f23-8eff-7e7eb8826958 req-c0558f7d-e73d-4058-9e02-b75715ce4dc6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:07.219751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-5f67f28c-e978-4f23-8eff-7e7eb8826958 req-c0558f7d-e73d-4058-9e02-b75715ce4dc6 service nova] Creating event network-vif-deleted:1bd6f1d7-5140-47ca-a79d-6899fb7d7339 for instance d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 on hv-cinder-78638 May 10 17:24:07.226545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-5f67f28c-e978-4f23-8eff-7e7eb8826958 req-c0558f7d-e73d-4058-9e02-b75715ce4dc6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047885 May 10 17:24:07.227152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 337/703] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:07.820729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:07.822259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:07.835880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:07.837033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:07.838806 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:07.839633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.012308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:08.013764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:08.021853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:08.022751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.024297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:08.024993 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.295452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:08.307202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:08.309322 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:08.311004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a9968e58-234a-4065-9865-295c402acd27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.495873 May 10 17:24:08.320284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 367/704] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:07 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:08.325178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:08.325984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:08.333745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:08.334469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.335473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:08.336072 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.407739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:08.408421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:08.409035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'fault' on Instance uuid d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:24:08.690000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:08.699887 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:08.709992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-68ac531a-6932-48ce-8417-fca54ecbe172 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1308 microversion: 2.1 time: 0.388237 May 10 17:24:08.720722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 368/705] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:08 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1308 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:08.722800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-38d22b90-7962-45ab-98cf-a8432a0d9eb9 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.718055 May 10 17:24:08.723601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 338/706] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:08 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:09.343423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:09.347422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:09.357731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.358391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.359505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.360189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.618592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:09.628964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:09.631648 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:09.634016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6b1cf4db-4622-473c-bc99-91fe0a3b9c3f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.294790 May 10 17:24:09.635658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 369/707] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:09 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:09.727872 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:09.728643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:09.740078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.740778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.742069 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:09.742788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:09.743541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.744223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.752386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.752858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.754047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.754904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.826365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:09.826897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:09.827566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'fault' on Instance uuid d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:24:09.898885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:09.917116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-90957d43-bd40-449b-81b0-70d0776eabf1 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1308 microversion: 2.1 time: 0.190347 May 10 17:24:09.917729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 339/708] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:09 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1308 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:10.052421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:10.064298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cf272d86-819b-4af6-ab11-b8bee663884c tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.326900 May 10 17:24:10.064960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 370/709] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:09 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:10.652448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:10.653315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:10.660803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:10.661632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:10.662618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:10.663249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:10.908202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:10.919376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:10.921009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:10.922408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1947d34f-1497-4f24-8527-7eb7a0e6a226 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.273684 May 10 17:24:10.923374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 340/710] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:10 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:10.934243 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:10.935706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:10.944716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:10.945327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:10.946406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:10.947105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:11.056312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:11.057062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:11.057538 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'fault' on Instance uuid d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:24:11.081471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:11.083471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:11.100455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:11.103969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:11.105386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:11.108307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:11.177616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:11.199314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5b694520-03b7-441b-83ac-285a4153e5b2 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 200 len: 1308 microversion: 2.1 time: 0.270122 May 10 17:24:11.207175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 371/711] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:10 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:11.406091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:11.416450 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2a9dff55-3f18-4e3e-b797-9a4a6ff9c413 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.339229 May 10 17:24:11.417270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 341/712] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:11 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:11.941040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:11.941593 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:11.948976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:11.949441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:11.950229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:11.950713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.174810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:12.183833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:12.185361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:12.186889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-81775710-af92-464c-94c7-966fabec5566 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.249783 May 10 17:24:12.187450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 372/713] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:11 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:12.221023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:12.221582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: d3c232b4-e9fa-4f10-8db8-cabb373ef0c1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:12.229940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.230427 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.231274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.231720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.281337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Instance d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 could not be found. May 10 17:24:12.281974 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 404 to user: Instance d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:24:12.282854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-191347ed-28d4-45ba-847a-0134db58a0de tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1" status: 404 len: 111 microversion: 2.1 time: 0.066005 May 10 17:24:12.283805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 342/714] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:12 2021] GET /compute/v2.1/servers/d3c232b4-e9fa-4f10-8db8-cabb373ef0c1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:24:12.291454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:12.292350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:12.299863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.300329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.301121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.301575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.366777 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:24:12.432641 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:12.433297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:12.441553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.442283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.443716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.445025 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.487040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5f221c9e-8e84-4776-a5e9-645cc28dce2f tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 204 len: 0 microversion: 2.1 time: 0.198937 May 10 17:24:12.487565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 373/715] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:24:12 2021] DELETE /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:24:12.495852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:12.496570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:12.503664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.504477 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.504937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:12.505415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:12.753121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:12.762154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6ad977d4-0c22-4bbf-92be-df40f29f752a tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.333155 May 10 17:24:12.774397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:12.780255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 343/716] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:12 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:12.783311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fcdba961-34ee-481d-bddb-f1cd1684b4e4 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1513 microversion: 2.1 time: 0.291495 May 10 17:24:12.784020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 374/717] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:12 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1513 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:12.957248 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1563235043", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "networks": [{"uuid": "59c79b3a-606f-480a-bc59-da16504e6cb0"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:13.027261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] validate_networks() for [('59c79b3a-606f-480a-bc59-da16504e6cb0', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:24:13.207307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:13.207975 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:13.221013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.221973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.222962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.223528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.736777 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:13.748538 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:13.750163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:13.751294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a6986dec-1f8a-4e87-b1ac-ec4c04242bd9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.549187 May 10 17:24:13.762547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 375/718] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:13 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:13.781253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:13.781925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:13.794830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.795349 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.796178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.796633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.818145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:24:13.819229 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:24:13.820555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:24:13.821142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:24:13.821718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:24:13.831737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.832193 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.833167 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.833782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.855272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Getting quotas for project 0c9cc9feff17427b9609bc260703b774. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:24:13.859525 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Getting quotas for user 34a86cc6459b424f8e6dc8b08e7dc5f0 and project 0c9cc9feff17427b9609bc260703b774. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:24:13.871262 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:24:13.874485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:24:13.938218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cdade5b7-fe38-4a6a-958a-9207e476cf9e tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.984616 May 10 17:24:13.944009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 344/719] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:24:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:24:13.949635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:13.950971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:13.960830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.961241 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:13.962035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:13.962505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:14.103300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:14.133119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e2e2979f-5b30-41b6-86d1-19e871356f38 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.357428 May 10 17:24:14.139356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 376/720] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:13 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:14.144645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ac3c7995-6056-48c8-bd36-e2f27c4b9b94 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:14.151215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ac3c7995-6056-48c8-bd36-e2f27c4b9b94 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:14.262266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ac3c7995-6056-48c8-bd36-e2f27c4b9b94 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:14.272116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ac3c7995-6056-48c8-bd36-e2f27c4b9b94 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1219 microversion: 2.1 time: 0.131324 May 10 17:24:14.272757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 377/721] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:14 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:14.389307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:14.401405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-16ece3fd-9ff8-4411-9f4e-8bea9b64f26d tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1513 microversion: 2.1 time: 0.455744 May 10 17:24:14.402597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 345/722] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:13 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:14.769246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:14.770159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:14.779039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:14.779690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:14.780488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:14.780926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.028949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:15.039901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:15.042090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:15.043548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5eb525cc-6a12-45e6-8359-21bd90847177 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.278496 May 10 17:24:15.044713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 378/723] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:14 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:15.153113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:15.155216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:15.164440 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.165263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.166321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.167245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.289786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:15.290652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:15.307388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.308187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.309398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.310101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.457112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:15.468022 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-47fe1cdd-0a53-4705-af23-fa2721481e44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1271 microversion: 2.1 time: 0.182683 May 10 17:24:15.479665 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 379/724] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:15 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:15.484490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:15.485572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:15.494800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.495531 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.496492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:15.498169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:15.750661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:15.763630 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-45e1dfb9-6387-4313-9996-d7d8982bafaf tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.614459 May 10 17:24:15.764870 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 346/725] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:15 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:16.062226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:16.063121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:16.082192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.083523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.086979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.089633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.183843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:16.195371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-52370f12-f32f-45ea-8f73-8ff26a7bff8c tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1513 microversion: 2.1 time: 0.713788 May 10 17:24:16.198482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 380/726] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:15 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:16.486743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:16.487459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:16.497536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.498278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.499264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.499868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.805688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:16.815747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c74da959-fb79-4100-8d3d-77d0a0716f5d tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1277 microversion: 2.1 time: 0.332868 May 10 17:24:16.826776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 381/727] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:16 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1277 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:16.831655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:16.832274 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:16.841171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.841801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.842751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.843370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.846304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:16.858579 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:16.860161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:16.861547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b9ee403e-a619-4b1f-94ef-7ccd1525cc57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.803145 May 10 17:24:16.862327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 347/728] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:16 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:16.867621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-fa5cdef0-4937-4936-9278-ca2be8ef9705 req-ad5e1ef8-6411-49c4-90b5-cf6e3660062e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df73bdaf-ec61-4dda-bc79-06dd29d537ee", "name": "network-vif-deleted", "tag": "63230674-0039-4b7c-80d1-e8ccab7f7656"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:16.870129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:16.870129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:24:16.889376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fa5cdef0-4937-4936-9278-ca2be8ef9705 req-ad5e1ef8-6411-49c4-90b5-cf6e3660062e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:16.890121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fa5cdef0-4937-4936-9278-ca2be8ef9705 req-ad5e1ef8-6411-49c4-90b5-cf6e3660062e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:16.908453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-fa5cdef0-4937-4936-9278-ca2be8ef9705 req-ad5e1ef8-6411-49c4-90b5-cf6e3660062e service nova] Creating event network-vif-deleted:63230674-0039-4b7c-80d1-e8ccab7f7656 for instance df73bdaf-ec61-4dda-bc79-06dd29d537ee on hv-cinder-78638 May 10 17:24:16.914667 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-fa5cdef0-4937-4936-9278-ca2be8ef9705 req-ad5e1ef8-6411-49c4-90b5-cf6e3660062e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050979 May 10 17:24:16.915457 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 348/729] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:17.216020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:17.216855 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:17.235899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.236361 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.237159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.237597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.334364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.334868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.335855 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lazy-loading 'fault' on Instance uuid df73bdaf-ec61-4dda-bc79-06dd29d537ee {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:24:17.352606 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:17.364976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a1403040-21c3-4529-b7c8-b9b1c8975087 tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1521 microversion: 2.1 time: 0.537146 May 10 17:24:17.374377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 382/730] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:16 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1521 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:17.508290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:17.525651 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-04a7bcaf-3c12-491e-9072-61da0f987796 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 200 len: 1307 microversion: 2.1 time: 0.310838 May 10 17:24:17.537953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 349/731] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:17 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:17.788422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-93e0543c-35c0-45d7-b983-5d38bcc5c567 req-7d636c1f-86fa-4a3e-83b9-f95c1c1ee9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568c5267-2f2c-4d3b-8364-a05c2b8192b1", "name": "network-vif-unplugged", "status": "completed", "tag": "efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:17.790144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:17.790144 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:24:17.809142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-93e0543c-35c0-45d7-b983-5d38bcc5c567 req-7d636c1f-86fa-4a3e-83b9-f95c1c1ee9fa service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.814289 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-93e0543c-35c0-45d7-b983-5d38bcc5c567 req-7d636c1f-86fa-4a3e-83b9-f95c1c1ee9fa service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.834708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:17.836252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:17.871609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.883834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.884961 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.887448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.888645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-93e0543c-35c0-45d7-b983-5d38bcc5c567 req-7d636c1f-86fa-4a3e-83b9-f95c1c1ee9fa service nova] Creating event network-vif-unplugged:efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd for instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 on hv-cinder-78638 May 10 17:24:17.899399 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-93e0543c-35c0-45d7-b983-5d38bcc5c567 req-7d636c1f-86fa-4a3e-83b9-f95c1c1ee9fa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129656 May 10 17:24:17.922845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 383/732] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:17.941452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:17.942633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:17.953463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.954272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:17.955535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:17.956242 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.614041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:18.634750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:18.636553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:18.641355 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7ed219af-3806-4c83-8981-b186939644f7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.715258 May 10 17:24:18.641892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:18.642438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 384/733] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:17 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:18.649119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:18.649755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:18.656544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-df8e4ff4-df13-4998-8cc1-2aac55646cd3 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.823311 May 10 17:24:18.657337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.657799 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.660297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.660763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.660874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 350/734] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:17 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:18.670145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:18.670815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: df73bdaf-ec61-4dda-bc79-06dd29d537ee] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:18.698854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.713159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.717405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.718055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.794204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.794769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:18.795154 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lazy-loading 'fault' on Instance uuid 568c5267-2f2c-4d3b-8364-a05c2b8192b1 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:24:18.844392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Instance df73bdaf-ec61-4dda-bc79-06dd29d537ee could not be found. May 10 17:24:18.845093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 404 to user: Instance df73bdaf-ec61-4dda-bc79-06dd29d537ee could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:24:18.846250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b82bb0ff-a9a0-4584-a9c5-ee89d5a280fa tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee" status: 404 len: 111 microversion: 2.1 time: 0.184161 May 10 17:24:18.846957 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 351/735] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:18 2021] GET /compute/v2.1/servers/df73bdaf-ec61-4dda-bc79-06dd29d537ee => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:24:18.964570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-963d3953-e79b-485f-ac72-c06f2eb230fe req-d7d4787c-10d9-4b10-a972-1953b4bed7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568c5267-2f2c-4d3b-8364-a05c2b8192b1", "name": "network-vif-deleted", "tag": "efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:18.966244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:18.966244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:24:18.979891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f505641645b4d039311aafbcd24d6b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc027d222ec41848aea01fc2452dce7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:18.998087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-963d3953-e79b-485f-ac72-c06f2eb230fe req-d7d4787c-10d9-4b10-a972-1953b4bed7bf service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:18.998309 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a7b229f3-8abc-4797-8981-52b5170ae2cd tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 200 len: 1312 microversion: 2.1 time: 0.349760 May 10 17:24:19.009962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-963d3953-e79b-485f-ac72-c06f2eb230fe req-d7d4787c-10d9-4b10-a972-1953b4bed7bf service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.010234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 385/736] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:18 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 1312 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:19.048699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-963d3953-e79b-485f-ac72-c06f2eb230fe req-d7d4787c-10d9-4b10-a972-1953b4bed7bf service nova] Creating event network-vif-deleted:efe5ed8d-49b7-4033-81f6-3d67fdb8b6cd for instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 on hv-cinder-78638 May 10 17:24:19.060804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-963d3953-e79b-485f-ac72-c06f2eb230fe req-d7d4787c-10d9-4b10-a972-1953b4bed7bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100086 May 10 17:24:19.067596 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 352/737] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:19.230615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-aac5f0b4-c9b2-4876-b92b-a62b8de73045 req-b2962cd0-b964-4b71-b2df-5470476ea6cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6c504f-159b-4fbc-ba80-696d63e34251", "tag": "f5ff2bc4-4101-4441-8889-11ac99dab78c"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:19.233721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:19.233721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:24:19.245957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-aac5f0b4-c9b2-4876-b92b-a62b8de73045 req-b2962cd0-b964-4b71-b2df-5470476ea6cf service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:19.247460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-aac5f0b4-c9b2-4876-b92b-a62b8de73045 req-b2962cd0-b964-4b71-b2df-5470476ea6cf service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.273364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-aac5f0b4-c9b2-4876-b92b-a62b8de73045 req-b2962cd0-b964-4b71-b2df-5470476ea6cf service nova] Creating event network-changed:f5ff2bc4-4101-4441-8889-11ac99dab78c for instance ec6c504f-159b-4fbc-ba80-696d63e34251 on hv-cinder-78638 May 10 17:24:19.281004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-aac5f0b4-c9b2-4876-b92b-a62b8de73045 req-b2962cd0-b964-4b71-b2df-5470476ea6cf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056802 May 10 17:24:19.282315 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 386/738] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:19.660832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:19.661473 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:19.669129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:19.669588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.670390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:19.670836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.674146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:19.674937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:19.683659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:19.684123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.684921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:19.685371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:19.960919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:19.969906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:19.971479 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:19.972638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2010ad5a-322e-486f-957b-41da8b9e4b10 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1740 microversion: 2.20 time: 0.316200 May 10 17:24:19.972797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:19.973255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 353/739] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:19 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:19.982670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dbaf98f3-540d-45fb-aa11-27a36eb5ad8f tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.313384 May 10 17:24:19.983940 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 387/740] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:19 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:20.015303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:20.015928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] [instance: 568c5267-2f2c-4d3b-8364-a05c2b8192b1] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:20.024215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.024944 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.025733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.026415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.076176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] HTTP exception thrown: Instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 could not be found. May 10 17:24:20.076802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] Returning 404 to user: Instance 568c5267-2f2c-4d3b-8364-a05c2b8192b1 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:24:20.077659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ca5d190b-7fae-4fe2-bf29-162cb1ea74be tempest-ServerRescueNegativeTestJSON-1722978074 tempest-ServerRescueNegativeTestJSON-1722978074-project] 10.222.0.32 "GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1" status: 404 len: 111 microversion: 2.1 time: 0.066237 May 10 17:24:20.078221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 354/741] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:20 2021] GET /compute/v2.1/servers/568c5267-2f2c-4d3b-8364-a05c2b8192b1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:24:20.233528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:20.234046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:20.242627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.243118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.243932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.244382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.309638 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:24:20.456150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e35015c0-97f8-4b7b-84ae-71813c2dee54 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 204 len: 0 microversion: 2.1 time: 0.226077 May 10 17:24:20.457087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 388/742] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:24:20 2021] DELETE /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:24:20.464741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:20.465369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:20.473052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.473646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.474468 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:20.475184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:20.848363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:20.860697 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-65ecb3d3-8607-47bd-8f5a-f4994e95d968 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.399641 May 10 17:24:20.862615 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 355/743] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:20 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:20.991906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:20.993030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:20.999280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:21.000172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:21.013471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.014016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:21.014893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.015346 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:21.027217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.027714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:21.029405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.039841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:21.710419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:21.718578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f9d0265f-f2af-4dbe-9292-2ced9dec9b6a tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.722935 May 10 17:24:21.719144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 356/744] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:20 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:21.722634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:21.732425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:21.733968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:21.735171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bd64be7f-5788-4e5e-aa75-e2f72d9c8768 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.747853 May 10 17:24:21.735735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 389/745] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:20 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:21.878647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:21.879396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:21.886840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.887290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:21.888092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:21.888534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:22.214825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:22.223125 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a5f8afc8-d7d7-4267-9c03-9909ec8d7841 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.348284 May 10 17:24:22.223773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 357/746] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:21 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:22.736154 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:22.736785 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:22.744652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:22.745109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:22.745898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:22.746364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:22.753299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:22.753950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:22.761517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:22.761977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:22.762791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:22.763231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:23.361222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:23.365772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:23.370253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c7f16e97-a902-44e8-9c9d-afbfabf0d670 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.637743 May 10 17:24:23.370850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 390/747] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:22 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:23.383060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:23.383323 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:23.384129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:23.384767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:23.385927 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6f367f2c-1332-487d-bfab-eb61d41780d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.636589 May 10 17:24:23.386859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 358/748] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:22 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:23.391731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:23.392194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:23.392991 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:23.393442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:23.797546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:23.806475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-11b720d5-db63-435d-98c7-4e2bdea2a9df tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.434408 May 10 17:24:23.815905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 391/749] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:23 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:24.389307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:24.390935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:24.406456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:24.407364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:24.415718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.416194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:24.416664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.417322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:24.417455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.417851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:24.418604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.419317 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:24.908750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:24.916593 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:24.917112 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-51f02b38-18a5-43f7-87fe-92bdd66e4183 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.531850 May 10 17:24:24.926062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 359/750] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:24 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:24.926062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:24.926062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:24.926373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:24.927964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:24.930165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1adaaf4e-d3fe-4d8f-bb87-652f8edf0cfc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.528568 May 10 17:24:24.930771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 392/751] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:24 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:24.930998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.931451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:24.934222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:24.934785 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:25.630489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:25.639087 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-886081c7-f2c1-4c5a-a455-076b6f602c6e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.720065 May 10 17:24:25.639681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 360/752] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:24 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:25.932870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:25.933491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:25.940760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:25.941225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:25.942036 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:25.942542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:25.948624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:25.949254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:25.956888 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:25.957355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:25.958174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:25.958655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:26.437730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:26.441639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:26.452036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:26.453720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:26.454752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-69e1e983-7b39-445e-a28b-507ed48fbf44 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.525470 May 10 17:24:26.455275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ec8d8153-72c4-4f9b-86fd-ed81f3da1f1f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.510854 May 10 17:24:26.456190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 361/753] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:25 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:26.461086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 393/754] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:25 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:26.656336 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:26.656959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:26.664824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:26.665278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:26.666059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:26.666794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.003581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:27.013659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2f2ffb24-1b07-4fef-82d5-d3d3013302d0 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.361099 May 10 17:24:27.014653 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 362/755] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:26 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:27.129728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-3888a350-3c24-42d9-87fc-a54f6fddf29f req-620a75a1-3d3f-4435-b363-cdfb1da5dff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "name": "network-vif-unplugged", "status": "completed", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:27.132589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:27.132589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:24:27.141368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-3888a350-3c24-42d9-87fc-a54f6fddf29f req-620a75a1-3d3f-4435-b363-cdfb1da5dff1 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:27.141951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-3888a350-3c24-42d9-87fc-a54f6fddf29f req-620a75a1-3d3f-4435-b363-cdfb1da5dff1 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.161343 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-3888a350-3c24-42d9-87fc-a54f6fddf29f req-620a75a1-3d3f-4435-b363-cdfb1da5dff1 service nova] Creating event network-vif-unplugged:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:24:27.168515 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-3888a350-3c24-42d9-87fc-a54f6fddf29f req-620a75a1-3d3f-4435-b363-cdfb1da5dff1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045810 May 10 17:24:27.169023 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 394/756] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:27 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:27.471674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:27.472532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:27.474096 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:27.475108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:27.482546 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:27.483006 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.483400 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:27.483789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:27.483923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.484503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.484723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:27.485178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:27.782312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:27.790087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:27.792502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b34902c5-a2e7-4aa8-a5b7-69a353c7f308 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.324692 May 10 17:24:27.793090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 363/757] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:27 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:27.798960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:27.800510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:27.802236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-79baa066-d9cc-47e9-95bf-8cd436c55df0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.332469 May 10 17:24:27.812846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 395/758] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:27 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:28.030950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:28.031941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:28.041076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.041962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:28.043307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.044160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:28.326895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:28.338057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4df5d6b8-8cbe-4013-8101-5c8f938b834e tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1513 microversion: 2.1 time: 0.310730 May 10 17:24:28.339083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 364/759] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:28 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:28.813520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:28.819850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:28.820480 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:28.823314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:28.841273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.842237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:28.843483 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.844192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:28.851748 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.852334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:28.853142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:28.853588 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:29.567630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:29.584078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a3a21c18-fe23-4299-805b-c887ad1ea797 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.778827 May 10 17:24:29.584767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 396/760] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:28 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:29.589354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:29.589981 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:29.609344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:29.609679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:29.610534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:29.612342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:29.612342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:29.621646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:29.624197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:29.625705 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1fcf5e8c-3d48-42eb-86ab-daeed39fc4ff tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1722 microversion: 2.20 time: 0.810097 May 10 17:24:29.626560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 365/761] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:28 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1722 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:29.966299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a32fb4db0ebb499a9cf1103e888cbbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0f782c325f1445b94f0ff94b78c2c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:29.969830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-2dc03119-cc35-4f41-bef3-b4be91a331b0 req-e2a46665-6599-4a73-bf59-86fed681aa77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b022bb70-cca1-48d9-98cc-c4f53580a1b9", "name": "network-vif-deleted", "tag": "7a435a01-5e96-4ca5-bec4-fb27c4859172"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:29.976111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:29.976111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:24:29.980445 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9d1d0e18-f8cd-4fb9-9083-d0c8b5cea2c7 tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 200 len: 1471 microversion: 2.1 time: 0.394597 May 10 17:24:29.989700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 397/762] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:29 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 1471 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:30.004848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2dc03119-cc35-4f41-bef3-b4be91a331b0 req-e2a46665-6599-4a73-bf59-86fed681aa77 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:30.005684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2dc03119-cc35-4f41-bef3-b4be91a331b0 req-e2a46665-6599-4a73-bf59-86fed681aa77 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:30.023834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-2dc03119-cc35-4f41-bef3-b4be91a331b0 req-e2a46665-6599-4a73-bf59-86fed681aa77 service nova] Creating event network-vif-deleted:7a435a01-5e96-4ca5-bec4-fb27c4859172 for instance b022bb70-cca1-48d9-98cc-c4f53580a1b9 on hv-cinder-78638 May 10 17:24:30.030840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-2dc03119-cc35-4f41-bef3-b4be91a331b0 req-e2a46665-6599-4a73-bf59-86fed681aa77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068753 May 10 17:24:30.032206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 366/763] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:30.603708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:30.603708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:30.619984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:30.620639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:30.623644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:30.624274 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:30.645245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:30.646191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:30.654328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:30.655032 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:30.658498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:30.659153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:30.973624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:30.996414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-384d94e7-5217-40dc-963d-f983a7a441fc tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.398917 May 10 17:24:30.997678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 398/764] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:30 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:31.013779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:31.019952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] [instance: b022bb70-cca1-48d9-98cc-c4f53580a1b9] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:31.028747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.029337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.030236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.030807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.041413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:31.060689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:31.062223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:31.063411 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-648b105d-4481-4942-89ba-0432b229467c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1665 microversion: 2.20 time: 0.422466 May 10 17:24:31.063978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 367/765] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:30 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1665 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:31.083200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04891ab0-8b42-4274-ae16-1849c359ddfd"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:31.084318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:31.087533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] HTTP exception thrown: Instance b022bb70-cca1-48d9-98cc-c4f53580a1b9 could not be found. May 10 17:24:31.088422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] Returning 404 to user: Instance b022bb70-cca1-48d9-98cc-c4f53580a1b9 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:24:31.089628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cc2e8f8e-f694-4e98-9057-11546af2d5ad tempest-AttachVolumeNegativeTest-539380594 tempest-AttachVolumeNegativeTest-539380594-project] 10.222.0.32 "GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9" status: 404 len: 111 microversion: 2.1 time: 0.081170 May 10 17:24:31.090747 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 399/766] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:31 2021] GET /compute/v2.1/servers/b022bb70-cca1-48d9-98cc-c4f53580a1b9 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:24:31.092716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.093178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.094283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.094750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.577872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-040729ad-f5d8-4302-ae84-aa708d1385c4 req-a615b227-79c0-4215-9947-162685c5d95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6c504f-159b-4fbc-ba80-696d63e34251", "name": "network-vif-plugged", "status": "completed", "tag": "f5ff2bc4-4101-4441-8889-11ac99dab78c"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:31.580268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:24:31.580268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:24:31.593448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-040729ad-f5d8-4302-ae84-aa708d1385c4 req-a615b227-79c0-4215-9947-162685c5d95e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.594079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-040729ad-f5d8-4302-ae84-aa708d1385c4 req-a615b227-79c0-4215-9947-162685c5d95e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.712129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cd4390ae-c100-4e7b-9f9e-d82395aeed7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.634440 May 10 17:24:31.712951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 368/767] 10.222.0.32 () {62 vars in 1364 bytes} [Mon May 10 17:24:31 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments => generated 188 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:24:31.791521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-040729ad-f5d8-4302-ae84-aa708d1385c4 req-a615b227-79c0-4215-9947-162685c5d95e service nova] Creating event network-vif-plugged:f5ff2bc4-4101-4441-8889-11ac99dab78c for instance ec6c504f-159b-4fbc-ba80-696d63e34251 on hv-cinder-78638 May 10 17:24:31.796318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-040729ad-f5d8-4302-ae84-aa708d1385c4 req-a615b227-79c0-4215-9947-162685c5d95e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224553 May 10 17:24:31.797279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 400/768] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:24:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:31.852969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:31.858033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:31.875594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.878896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:31.879890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:31.882954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:32.015021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:32.016150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:32.031162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:32.032793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:32.034662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:32.038887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:32.097070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bbcb4300-3a6d-4695-b76c-24ba2a1fd602 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action" status: 202 len: 0 microversion: 2.20 time: 0.255502 May 10 17:24:32.102383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 369/769] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:24:31 2021] POST /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:24:32.109099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:32.109937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:32.122656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:32.123321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:32.124285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:32.125849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:32.468777 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:32.479189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f9ae7853-59e1-415c-ade3-8e531beacf82 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.469473 May 10 17:24:32.480584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 401/770] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:32 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:32.626285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:32.647438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:32.659675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:32.661158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ba46674a-3c63-4162-a9ce-ea2f88693210 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1751 microversion: 2.20 time: 0.557571 May 10 17:24:32.662258 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 370/771] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:32 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1751 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:33.496365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:33.497233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:33.505750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:33.509790 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:33.511424 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:33.512130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:33.682437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:33.684102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:33.696090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:33.696556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:33.698459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:33.699429 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:34.064492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:34.072284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bd6e0c24-772d-4e61-b476-1298c113e63b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1319 microversion: 2.1 time: 0.579542 May 10 17:24:34.078759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 402/772] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:33 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:34.334211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:34.350600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:34.355201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:34.359839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8b053a01-bced-4d78-a899-b8b2dde7004c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1751 microversion: 2.20 time: 0.681413 May 10 17:24:34.362737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 371/773] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:33 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1751 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:35.089611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:35.090464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:35.106480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.106955 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.107766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.110737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.390756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:35.397786 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:35.415933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.416381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.422883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.423562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.522879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:35.541280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f5eec24c-255c-47ba-8613-cfdb54a00f7c tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1506 microversion: 2.1 time: 0.452313 May 10 17:24:35.553004 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 403/774] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:35 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:35.558256 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30f8c3fb-f8d6-4702-b06a-3d857235b02a", "device": "/dev/sdb"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:35.559589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:35.567939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.568686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.570224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:35.570920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:35.845760 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:35.856563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:35.858100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:35.859592 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9245a994-a53b-4f41-a903-4df9eb8748a8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1753 microversion: 2.20 time: 0.482069 May 10 17:24:35.872075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 372/775] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:35 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1753 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:36.469864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8c707d35-ec9b-4fbe-b132-78f5e0327ca9 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "POST /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914460 May 10 17:24:36.471409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 404/776] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:24:35 2021] POST /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251/os-volume_attachments => generated 194 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:36.832370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: .version_select at 0x7f4144828ca0>, body: {"keypair": {"name": "tempest-keypair-1224096963"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:36.860976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:24:36.865472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:24:36.890139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:36.891420 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:36.902518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:36.903466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:36.904426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:36.905030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:37.115617 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:24:37.120531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:24:37.135261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3d12370c-7393-4ad8-a427-cc53a8bcff2e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.387721 May 10 17:24:37.136339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 373/777] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 10 17:24:36 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:37.444624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:37.466246 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:37.467850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:37.471735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-82f75a43-1f07-4df8-bfa1-262b738dfa56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.597124 May 10 17:24:37.476137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 405/778] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:36 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:37.924246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e8a01ca8-ab25-4fa0-b3d8-f115c7d00c67 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f4144828430>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:38.151267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e8a01ca8-ab25-4fa0-b3d8-f115c7d00c67 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/1e9aef84-12ed-40e9-9cc8-7ff251757d2b" status: 200 len: 350 microversion: 2.1 time: 0.230243 May 10 17:24:38.151865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 374/779] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:24:37 2021] GET /compute/v2.1/os-volumes/1e9aef84-12ed-40e9-9cc8-7ff251757d2b => generated 350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:38.493609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:38.495099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:38.510935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:38.512850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:38.516164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:38.521860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:39.044251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:39.059174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:39.062958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:39.066105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ffb20ead-5de9-4cc7-8b37-e75e0797bd73 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.578492 May 10 17:24:39.070027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 406/780] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:38 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:39.677428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-860225602", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64b55f2c-b19a-482d-8023-f6baaecf0a48"}], "security_groups": [{"name": "tempest-securitygroup--1705720465"}], "key_name": "tempest-keypair-1224096963", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:24:40.088398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:40.089028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:40.112403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:40.113217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:40.114521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:40.115150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:40.432267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:40.442709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:40.446428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:40.449528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d827b36d-a3c3-4b49-a801-db21d47d9133 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.364591 May 10 17:24:40.450168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 407/781] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:40 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:41.091627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ea424950-f332-458a-abd3-afac2805fac3 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f414511b040>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:41.205249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ea424950-f332-458a-abd3-afac2805fac3 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/39216938-2345-4107-9712-c274f2a5488b" status: 200 len: 351 microversion: 2.1 time: 0.117162 May 10 17:24:41.205825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 408/782] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:24:41 2021] GET /compute/v2.1/os-volumes/39216938-2345-4107-9712-c274f2a5488b => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:41.467593 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:41.468241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:41.476446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:41.477067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:41.478421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:41.478881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:41.837793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:41.848216 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:41.855318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:41.857555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8be8cf3c-bdb2-4bd7-8ddf-2200b402147f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.393611 May 10 17:24:41.858227 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 409/783] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:41 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:42.882483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:42.883459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:42.907229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:42.907836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:42.908792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:42.909334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:43.128185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:43.137795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:43.139291 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:43.140433 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c68014e1-5362-4b0b-a132-2a34a664b45e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.265054 May 10 17:24:43.140982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 410/784] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:42 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:43.912334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1c64338f-2be2-45bc-8d6c-34362c240836 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f414524d5e0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.036170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1c64338f-2be2-45bc-8d6c-34362c240836 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/f77e59a8-7825-4037-9e31-4fe558b051f9" status: 200 len: 351 microversion: 2.1 time: 0.119314 May 10 17:24:44.037467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 411/785] 10.222.0.32 () {58 vars in 1245 bytes} [Mon May 10 17:24:43 2021] GET /compute/v2.1/os-volumes/f77e59a8-7825-4037-9e31-4fe558b051f9 => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:44.052214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f4dce74f-7dac-47b5-a7aa-bdc1494e4588 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f41445df9d0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.147147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f4dce74f-7dac-47b5-a7aa-bdc1494e4588 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093985 May 10 17:24:44.155464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 412/786] 10.222.0.32 () {58 vars in 1134 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:44.172319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dd707b00-78c5-4c0d-9fa8-d7aa1d9b8f7e tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f4145234280>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.257296 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dd707b00-78c5-4c0d-9fa8-d7aa1d9b8f7e tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100645 May 10 17:24:44.257978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 413/787] 10.222.0.32 () {58 vars in 1149 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:24:44.273608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.274317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:44.282831 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:44.283293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:44.284186 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:44.284679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:44.505400 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:44.516272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:44.517916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:44.519172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a0a793ce-c283-4fb3-8714-2bb4064011e2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.250224 May 10 17:24:44.519739 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 414/788] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:44.524801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cf4a597a-f075-41bb-93d5-a85f7d691c1c tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f41452461f0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.618109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cf4a597a-f075-41bb-93d5-a85f7d691c1c tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.097291 May 10 17:24:44.625282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 415/789] 10.222.0.32 () {58 vars in 1134 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:44.630219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9924c744-876d-40d7-8b95-6a4850bd8c06 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f41452341f0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.715252 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9924c744-876d-40d7-8b95-6a4850bd8c06 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088598 May 10 17:24:44.715824 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 416/790] 10.222.0.32 () {58 vars in 1167 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:44.728224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-384fbd9c-931f-4d0b-8d2b-5f93d0d11c79 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f414524d550>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.829068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-384fbd9c-931f-4d0b-8d2b-5f93d0d11c79 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.104654 May 10 17:24:44.829916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 417/791] 10.222.0.32 () {58 vars in 1170 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:44.842876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-229a8d0b-e437-41a5-aff8-0c348d2f4b1b tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f4144f7cee0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:44.929732 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-229a8d0b-e437-41a5-aff8-0c348d2f4b1b tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090554 May 10 17:24:44.930403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 418/792] 10.222.0.32 () {58 vars in 1155 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:44.940979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2608dc64-6807-4d71-afa9-a7e77a5f513e tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f414511baf0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:45.028477 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2608dc64-6807-4d71-afa9-a7e77a5f513e tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090930 May 10 17:24:45.029158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 419/793] 10.222.0.32 () {58 vars in 1188 bytes} [Mon May 10 17:24:44 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:24:45.039986 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-51f3b44d-e0ad-4999-b5c9-88c487b23e66 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] Calling method '.version_select at 0x7f4145316dc0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:45.127916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-51f3b44d-e0ad-4999-b5c9-88c487b23e66 tempest-VolumesTestJSON-1664734148 tempest-VolumesTestJSON-1664734148-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091227 May 10 17:24:45.128678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 420/794] 10.222.0.32 () {58 vars in 1155 bytes} [Mon May 10 17:24:45 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:24:45.537169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:45.538983 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:45.546185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:45.546689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:45.547495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:45.547949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:45.779639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:45.789794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:45.791295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:45.792499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b02fed2b-9596-47d3-a17c-297e2b65a87b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.259261 May 10 17:24:45.793050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 421/795] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:45 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:46.812067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:46.812794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:46.820379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:46.820771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:46.821547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:46.821991 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:47.044973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:47.054247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:47.055828 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:47.056966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d798d2cd-fe1a-4c7e-87d7-2d63cde8c7c2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.248785 May 10 17:24:47.057526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 422/796] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:46 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:48.075533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:48.076170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:48.083428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:48.083894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:48.084679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:48.085129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:48.308232 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:48.319474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:48.321003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:48.322158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3249dd2a-cf25-4bea-ab4a-f23f9ff09bec tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.250443 May 10 17:24:48.332784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 423/797] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:48 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:49.340640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:49.341380 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:49.349089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:49.349646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:49.351061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:49.351581 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:49.736676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:49.746405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:49.747919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:49.749071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6f085bfb-b8cb-4cba-85a6-50a818118310 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.412434 May 10 17:24:49.749635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 424/798] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:49 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:50.768176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:50.769021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:50.782372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:50.782906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:50.783923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:50.795173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:51.050791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:51.060470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:51.062292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:51.063567 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ca58fec7-47ce-4b0a-bcb0-cad02b11d187 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.299335 May 10 17:24:51.070473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 425/799] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:50 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:51.351142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] validate_networks() for [('64b55f2c-b19a-482d-8023-f6baaecf0a48', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:24:52.079342 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:24:52.079774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:24:52.080560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:24:52.083000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:24:52.083222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:24:52.095100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:52.095100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:52.095100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:52.095100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:52.126165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:24:52.130457 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:24:52.141839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:24:52.144566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:24:52.195682 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2fad03a-c09f-468a-84c4-267898f2923b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 12.522448 May 10 17:24:52.197139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 375/800] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:24:39 2021] POST /compute/v2.1/servers => generated 402 bytes in 12524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:24:52.210227 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-211aaf88-1a4d-4d57-9186-0be26ecb62d2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:52.211519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-211aaf88-1a4d-4d57-9186-0be26ecb62d2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:52.309523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-211aaf88-1a4d-4d57-9186-0be26ecb62d2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:52.323497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:52.324783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:52.329791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-211aaf88-1a4d-4d57-9186-0be26ecb62d2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1237 microversion: 2.1 time: 0.126269 May 10 17:24:52.330700 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 376/801] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:52 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:52.333250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:52.333941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:52.335542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:52.336184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:52.578837 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:52.589630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:52.591268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:52.592441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dc03052f-12bd-46b7-adad-13afb6a6456c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.513347 May 10 17:24:52.593006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 426/802] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:52 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:53.347263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:53.347986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:53.356120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:53.356710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:53.357592 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:53.358143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:53.485907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:53.494764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-02fd69a7-dccc-4ce1-9072-295a49e747d0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1241 microversion: 2.1 time: 0.151197 May 10 17:24:53.495545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 377/803] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:53 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:53.611723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:53.612341 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:53.620350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:53.620812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:53.621594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:53.622035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:53.901460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:53.912209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:53.913906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:53.915340 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ff5cdd19-7559-4ea0-ad78-3f89f4651df1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.307852 May 10 17:24:53.917259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 427/804] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:53 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:24:54.511375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:54.512031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:54.520299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:54.520750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:54.521565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:54.522009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:54.653832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:54.661885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c3b1d5ec-e62d-4bf0-bc13-eed9966ef657 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1241 microversion: 2.1 time: 0.154265 May 10 17:24:54.662641 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 378/805] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:54 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:54.933416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:54.934119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:54.941473 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:54.942001 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:54.942909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:54.943418 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:55.154308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:55.164165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:55.165698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:55.166900 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0e07ccc5-e13b-4c24-8ddb-77f18f0f7c82 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.237199 May 10 17:24:55.167450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 428/806] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:54 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:55.677631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:55.678659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:55.686209 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:55.686772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:55.687761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:55.688207 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:55.802564 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:55.811442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-67ac5653-4273-469a-93e0-c5286cfb95fd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1241 microversion: 2.1 time: 0.137612 May 10 17:24:55.812074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 379/807] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:55 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:56.185464 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:56.186886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:56.195745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:56.196191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:56.197197 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:56.197661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:56.528592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:56.540180 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:56.541745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:56.543277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0032d836-091a-487c-8a08-dedafb5de2c3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.362110 May 10 17:24:56.544248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 429/808] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:56 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:56.828180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:56.829436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:56.836877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:56.837333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:56.838118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:56.838581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:57.002797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:57.013445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6cf2822c-f7e8-4ac2-8b78-56522d54fb95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1289 microversion: 2.1 time: 0.188933 May 10 17:24:57.014139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 380/809] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:56 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1289 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:57.563087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:57.563809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:57.571794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:57.572330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:57.573186 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:57.573702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:57.934786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:57.948188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:57.950214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:57.951728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b452ebdd-9b2e-4f1f-ae1a-c7a71f9ee045 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.392516 May 10 17:24:57.952484 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 430/810] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:57 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:58.030810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:58.032126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:58.043508 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:58.046897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:58.060230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:58.060230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:58.198783 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:58.207558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e148003f-e95b-4189-8b0d-e399c76c7607 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1295 microversion: 2.1 time: 0.180565 May 10 17:24:58.208220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 381/811] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:58 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1295 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:24:58.968918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:58.969545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:58.980131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:58.980594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:58.981382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:58.981828 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:59.227086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:24:59.227715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:24:59.243428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:59.244216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:59.245187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:24:59.249729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:24:59.498029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:59.508029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:59.509605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:59.510966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-870a003b-ac8c-4138-a0f1-acfcf1d406dd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.545713 May 10 17:24:59.511535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 431/812] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:24:58 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:24:59.707370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:24:59.715771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ed849242-074b-4b45-8ab9-9d23af58ab3b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.493254 May 10 17:24:59.716477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 382/813] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:24:59 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:00.130727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-01cdc501-4ccd-4ce1-89ef-92694c9897c8 req-41d58e97-44ba-410c-b3db-93d00ceb6fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48120777-14d3-4deb-9f45-1146dc41c5c6", "tag": "efcf780a-b180-4ccf-83b7-ac9d45b35052"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:00.132293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:25:00.132293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:25:00.140475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-01cdc501-4ccd-4ce1-89ef-92694c9897c8 req-41d58e97-44ba-410c-b3db-93d00ceb6fec service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:00.140931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-01cdc501-4ccd-4ce1-89ef-92694c9897c8 req-41d58e97-44ba-410c-b3db-93d00ceb6fec service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:00.166422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-01cdc501-4ccd-4ce1-89ef-92694c9897c8 req-41d58e97-44ba-410c-b3db-93d00ceb6fec service nova] Creating event network-changed:efcf780a-b180-4ccf-83b7-ac9d45b35052 for instance 48120777-14d3-4deb-9f45-1146dc41c5c6 on hv-cinder-78638 May 10 17:25:00.172389 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-01cdc501-4ccd-4ce1-89ef-92694c9897c8 req-41d58e97-44ba-410c-b3db-93d00ceb6fec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045283 May 10 17:25:00.174498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 432/814] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:25:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:25:00.529161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:00.529782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:00.537681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:00.538137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:00.538950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:00.539389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:00.733471 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:00.734308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:00.741604 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:00.742063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:00.742901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:00.743336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:00.987647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:00.997322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:00.998913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:01.000059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3868600b-9185-445f-9bac-a06bc77195ac tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.474752 May 10 17:25:01.010946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 383/815] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:00 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:01.087253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:01.095586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-88c5a978-a337-49dd-b8ce-d2e572cfd240 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.366277 May 10 17:25:01.096153 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 433/816] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:00 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:02.018060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:02.018654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:02.026137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:02.026624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:02.027401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:02.027843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:02.112412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:02.113073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:02.121170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:02.121632 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:02.122447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:02.122902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:02.268394 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:02.277943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:02.279505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:02.280646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6b4f6af4-b2c1-455b-9bf7-557b80e17d29 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.266487 May 10 17:25:02.281208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 384/817] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:02 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:02.341215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:02.349320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c85a2ea0-8bb9-4c4c-9775-bf085e4f7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.240632 May 10 17:25:02.350767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 434/818] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:02 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:03.299225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:03.299896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:03.307733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:03.308194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:03.308972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:03.309420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:03.367298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:03.367956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:03.375250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:03.375708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:03.376499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:03.376945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:03.556116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:03.565954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:03.567640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:03.568941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bb1f94e8-ec80-45b7-ba82-e3124bcdd7a4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.273368 May 10 17:25:03.569499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 385/819] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:03 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:03.625043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:03.633240 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-15f9334f-28aa-4349-8c39-7b2a3c0504a5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.270363 May 10 17:25:03.633804 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 435/820] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:03 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:04.587172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:04.587801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:04.595118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:04.595575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:04.596357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:04.596803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:04.649233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:04.649855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:04.657118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:04.657653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:04.658396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:04.658851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:04.841624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:04.852794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:04.854379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:04.856449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7116f11a-5030-48f6-adf6-69e5c64842bc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.272322 May 10 17:25:04.856449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 386/821] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:04 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:04.913030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:04.921103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-05684d85-33a8-4d57-bc88-12de5bf2b563 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.275589 May 10 17:25:04.921838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 436/822] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:04 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:05.872978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:05.873692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:05.881633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:05.882086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:05.882892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:05.883332 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:05.937654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:05.938275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:05.946151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:05.946654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:05.947432 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:05.947874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:06.124576 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:06.134506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:06.136026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:06.137173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e5060e6b-292d-47e2-bdf1-bdc4d6d25b01 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.268031 May 10 17:25:06.137921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 387/823] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:05 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:06.198184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:06.206228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-556d5581-2fe8-4dc2-8b5b-f8347fe0026b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.272331 May 10 17:25:06.206823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 437/824] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:05 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:07.155103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:07.155723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:07.163455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:07.163907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:07.164687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:07.165123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:07.222714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:07.223559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:07.232319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:07.232853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:07.233860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:07.234394 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:07.410272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:07.420304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:07.421824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:07.422998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a28d1420-78a3-4d04-b532-3d405874c227 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.271595 May 10 17:25:07.423560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 388/825] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:07 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:07.483250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:07.491393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-347c773a-487d-40ad-b47b-1ee44ec52263 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.272367 May 10 17:25:07.491953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 438/826] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:07 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:08.440510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:08.441157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:08.449137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:08.449595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:08.450392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:08.450832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:08.508620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:08.509179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:08.516718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:08.517260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:08.518150 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:08.518630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:08.699571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:08.713096 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:08.715217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:08.717504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7ed1d4ef-a063-41a0-b8b6-e02a59c0bccf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.279881 May 10 17:25:08.718268 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 389/827] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:08 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:08.819423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:08.827608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e8379700-7279-445f-ab33-7d7d26cf480b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.323441 May 10 17:25:08.828368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 439/828] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:08 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:09.736766 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:09.737343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:09.745024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:09.745484 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:09.746267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:09.746732 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:09.844714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:09.846014 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:09.853759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:09.854297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:09.855181 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:09.855691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:09.990679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:10.004942 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:10.007547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:10.010444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-77a08f2c-3c81-4c3f-a24a-97a5074e0829 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.277348 May 10 17:25:10.011865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 390/829] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:09 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:10.097924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:10.107103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bfc64195-8bc5-4402-907f-2aa0e5f6e581 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.266283 May 10 17:25:10.107673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 440/830] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:09 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:11.032213 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:11.032835 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:11.040322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:11.040781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:11.041563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:11.042007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:11.125025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:11.125729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:11.134128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:11.134693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:11.135582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:11.136093 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:11.434772 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:11.443006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-64f34130-82ae-47b6-9998-194d56815cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.322194 May 10 17:25:11.444149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 441/831] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:11 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:11.445351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:11.454926 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:11.456454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:11.457591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2e46f909-ba03-48a3-b553-44d202d97351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.429105 May 10 17:25:11.458146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 391/832] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:11 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:12.462037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:12.462627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:12.469950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:12.470443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:12.471231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:12.471680 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:12.474880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:12.475756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:12.482977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:12.483431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:12.484206 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:12.484648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:12.762219 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:12.766672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:12.770476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-15593468-a417-4451-8587-191a0d432b4a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.312837 May 10 17:25:12.771055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 442/833] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:12 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:12.776074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:12.777587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:12.778739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ee01dfef-678a-4971-9c7b-be24d4014a24 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.307557 May 10 17:25:12.779270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 392/834] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:12 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:13.787450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:13.788078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:13.795437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:13.795909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:13.796079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:13.796709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:13.796818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:13.797163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:13.804489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:13.804951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:13.805735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:13.806181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:14.088836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:14.091538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:14.097020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-367da97f-7d51-44d7-aa13-51a8bd1b40e2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.313804 May 10 17:25:14.097588 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 443/835] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:13 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:14.101618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:14.103259 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:14.104512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-48f6c025-0156-4a64-b44b-cd4b06c97860 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.312092 May 10 17:25:14.105133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 393/836] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:13 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:15.113257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:15.113874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:15.121237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:15.121427 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:15.121836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:15.122044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:15.122483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:15.122925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:15.129150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:15.129601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:15.130391 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:15.130831 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:15.491557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:15.499972 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:15.501792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:15.503448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:15.504689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8ae833ee-7710-41e9-9dc8-5d970dd72e56 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.386990 May 10 17:25:15.505258 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 394/837] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:15 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:15.509963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-876cb1e2-e6d8-42cd-a0df-c262c47b7d53 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.400312 May 10 17:25:15.510766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 444/838] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:15 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:16.524005 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:16.524627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:16.526997 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:16.527622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:16.532037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:16.532435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:16.533217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:16.533662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:16.534711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:16.535173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:16.535950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:16.536396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:16.821392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:16.827693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:16.830550 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:16.832073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:16.833210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7a77d4cf-0182-45a1-a188-edb372eea695 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.313568 May 10 17:25:16.834355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 395/839] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:16 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:16.836652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ceb163e5-a8da-424c-bf59-2d285d3b7e83 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.313391 May 10 17:25:16.837217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 445/840] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:16 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:17.851995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:17.852721 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:17.853069 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:17.853907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:17.860300 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:17.860835 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:17.861543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:17.861892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:17.862146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:17.862550 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:17.863238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:17.863880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:18.155606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:18.170066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:18.171649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:18.172811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-636da7bc-4d29-4139-8e62-37680f024d23 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.324904 May 10 17:25:18.177253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:18.183505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 396/841] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:17 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:18.185791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c36066de-6564-4ba7-84c8-112374b58ecf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.336827 May 10 17:25:18.186368 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 446/842] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:17 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:19.190297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:19.190988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:19.199221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:19.199221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:19.199499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:19.199884 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:19.206012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:19.206668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:19.231014 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:19.231481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:19.232286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:19.232736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:19.493861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:19.498071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:19.503569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:19.505192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:19.506841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ef81467a-338c-48b6-a1d7-b4077896b1a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.308227 May 10 17:25:19.507144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1e12fa4c-c2ea-4a0d-9d47-2ec1cf36cca5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.320709 May 10 17:25:19.507415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 447/843] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:19 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:19.507840 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 397/844] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:19 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:20.523329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:20.524001 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:20.524554 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:20.525170 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:20.531548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:20.532015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:20.532428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:20.532801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:20.532904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:20.533252 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:20.533634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:20.534070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:20.820688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:20.823233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:20.828713 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1cd5dba8-b1cc-457c-a38d-4998f4fbce04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.309164 May 10 17:25:20.829291 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 448/845] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:20 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:20.832510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:20.834035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:20.835202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-543f1b57-c751-4080-a753-12bc06bfa826 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.314323 May 10 17:25:20.835746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 398/846] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:20 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:21.844918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:21.845546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:21.853133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:21.853754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:21.853892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:21.854388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:21.855184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:21.855633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:21.860826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:21.861280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:21.862051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:21.862525 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:22.150036 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:22.154499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:22.158208 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b93820ff-1fee-4cc7-8ca5-8a8440be7ff9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.317039 May 10 17:25:22.158841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 449/847] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:21 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:22.163827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:22.165425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:22.166588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-14d1c11b-d764-44c7-add2-01cce8815b13 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.317982 May 10 17:25:22.167130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 399/848] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:21 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:23.174668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:23.175320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:23.183006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:23.183463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:23.184211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:23.184624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:23.184718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:23.184882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:23.192037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:23.192523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:23.193954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:23.194425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:23.483852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:23.493468 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ea093113-ab3f-4265-bfb6-1afa0de101b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.322444 May 10 17:25:23.494116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 450/849] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:23 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:23.496044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:23.508715 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:23.510316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:23.512523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-35a3f385-b9a8-4c7d-b2c4-09d8c0e0cd2d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.332043 May 10 17:25:23.513245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 400/850] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:23 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:23.711113 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-a6d4f969-fbb4-488d-acf7-4f8b84552df7 req-5abfdb07-9e5c-4dae-83fa-c38c34d47876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "name": "network-vif-plugged", "status": "completed", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:23.712790 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:25:23.712790 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:25:23.721254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-a6d4f969-fbb4-488d-acf7-4f8b84552df7 req-5abfdb07-9e5c-4dae-83fa-c38c34d47876 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:23.721718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-a6d4f969-fbb4-488d-acf7-4f8b84552df7 req-5abfdb07-9e5c-4dae-83fa-c38c34d47876 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:23.737896 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-a6d4f969-fbb4-488d-acf7-4f8b84552df7 req-5abfdb07-9e5c-4dae-83fa-c38c34d47876 service nova] Creating event network-vif-plugged:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:25:23.742889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-a6d4f969-fbb4-488d-acf7-4f8b84552df7 req-5abfdb07-9e5c-4dae-83fa-c38c34d47876 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 May 10 17:25:23.743610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 451/851] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:25:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:25:24.510173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:24.510805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:24.518138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:24.518631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:24.519412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:24.519850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:24.531103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:24.532460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:24.541027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:24.541664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:24.543014 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:24.543611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:24.840055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:24.853430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0396c17b-e0b8-4ee9-9b5a-303fde9481cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.346785 May 10 17:25:24.862285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:24.863544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 401/852] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:24 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:24.872005 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:24.873561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:24.874744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-37a34d08-8c5e-491f-842e-c89907b00d2c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.347863 May 10 17:25:24.875299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 452/853] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:24 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:25.766804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-6f0a916c-842a-4883-8b05-b84d5bcfcdd1 req-81658562-5546-4599-980b-eccfef927f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48120777-14d3-4deb-9f45-1146dc41c5c6", "name": "network-vif-plugged", "status": "completed", "tag": "efcf780a-b180-4ccf-83b7-ac9d45b35052"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:25.769101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:25:25.769101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:25:25.779061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-6f0a916c-842a-4883-8b05-b84d5bcfcdd1 req-81658562-5546-4599-980b-eccfef927f3c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:25.779675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-6f0a916c-842a-4883-8b05-b84d5bcfcdd1 req-81658562-5546-4599-980b-eccfef927f3c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:25.798796 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-6f0a916c-842a-4883-8b05-b84d5bcfcdd1 req-81658562-5546-4599-980b-eccfef927f3c service nova] Creating event network-vif-plugged:efcf780a-b180-4ccf-83b7-ac9d45b35052 for instance 48120777-14d3-4deb-9f45-1146dc41c5c6 on hv-cinder-78638 May 10 17:25:25.804614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-6f0a916c-842a-4883-8b05-b84d5bcfcdd1 req-81658562-5546-4599-980b-eccfef927f3c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044732 May 10 17:25:25.805425 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 402/854] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:25:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:25:25.870257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:25.870918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:25.878556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:25.879244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:25.880798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:25.881418 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:25.895283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:25.897072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:25.921224 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:25.921681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:25.922689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:25.923284 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:26.273330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:26.286250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-300600f5-ae67-49f1-8f09-a208b78b50ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.419576 May 10 17:25:26.295454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 453/855] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:25 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:26.295454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:26.295454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:26.301203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:26.301917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:26.303411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:26.303866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:26.381903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:26.393306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:26.395363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:26.396956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-24b5245d-fdc4-4cce-95c3-7e07ab273d4d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.506588 May 10 17:25:26.406477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 403/856] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:25 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:25:26.800699 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lazy-loading 'services' on Instance uuid ec6c504f-159b-4fbc-ba80-696d63e34251 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:25:26.942221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4a4a9398-e232-43ca-9706-9c09665e1312 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251/os-volume_attachments/30f8c3fb-f8d6-4702-b06a-3d857235b02a" status: 202 len: 0 microversion: 2.1 time: 0.653471 May 10 17:25:26.943459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 454/857] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:25:26 2021] DELETE /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251/os-volume_attachments/30f8c3fb-f8d6-4702-b06a-3d857235b02a => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:25:27.302567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:27.303295 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:27.311218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:27.311707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:27.312745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:27.313195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:27.417124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:27.418165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:27.426650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:27.427353 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:27.428309 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:27.428906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:27.567423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:27.576494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2ea99736-3db4-415a-b7ea-259f081afbe5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1363 microversion: 2.1 time: 0.278151 May 10 17:25:27.586169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 404/858] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:27 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:27.657189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:27.666960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:27.668475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:27.669682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-067064b0-3db4-4ca5-8137-dd9df32419cc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1809 microversion: 2.20 time: 0.257444 May 10 17:25:27.670237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 455/859] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:27 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:28.593336 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:28.593893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:28.602028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.602530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.603320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.603767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.688018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:28.688802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:28.696265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.696728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.697519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.697966 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.847716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:28.856761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5049dae9-e1b2-4304-99bf-dc0916678dca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1549 microversion: 2.1 time: 0.267171 May 10 17:25:28.857686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 405/860] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:28 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:28.874538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:28.875032 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:28.883797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.884489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.885290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:28.885956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:28.927412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:28.937376 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:28.938967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:28.940119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4f5a6220-16a3-48df-9965-1c4b448978f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1796 microversion: 2.20 time: 0.255998 May 10 17:25:28.940681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 456/861] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:25:28 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1796 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:25:29.042917 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f4a42d78-da77-434d-bc2d-3f2884502d9e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173356 May 10 17:25:29.049264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 406/862] 10.222.0.32 () {58 vars in 1275 bytes} [Mon May 10 17:25:28 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:25:29.292711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:29.293234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:29.300409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:29.300868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:29.301655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:29.302662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:29.363814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:25:29.507542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2ce94201-a5e5-4a00-844b-91484d1612b5 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 204 len: 0 microversion: 2.1 time: 0.218008 May 10 17:25:29.511438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 457/863] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:25:29 2021] DELETE /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:25:29.518834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:29.519489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:29.529577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:29.530294 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:29.531382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:29.531988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:29.998323 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:30.009001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-58fe726e-c6ed-4f17-b644-f7bc8090822b tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1512 microversion: 2.1 time: 0.495711 May 10 17:25:30.010092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 407/864] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:29 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:30.784364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:30.787480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:30.797140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:30.798800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:30.800499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:30.803262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:30.939886 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-9f7cd893-c345-4c59-b3fc-911f23cbe068 req-e84427e1-dc3f-47d6-9c3b-625345037cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48120777-14d3-4deb-9f45-1146dc41c5c6", "tag": "efcf780a-b180-4ccf-83b7-ac9d45b35052"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:30.941472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:25:30.941472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:25:30.950256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-9f7cd893-c345-4c59-b3fc-911f23cbe068 req-e84427e1-dc3f-47d6-9c3b-625345037cdd service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:30.950765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-9f7cd893-c345-4c59-b3fc-911f23cbe068 req-e84427e1-dc3f-47d6-9c3b-625345037cdd service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:30.966698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-9f7cd893-c345-4c59-b3fc-911f23cbe068 req-e84427e1-dc3f-47d6-9c3b-625345037cdd service nova] Creating event network-changed:efcf780a-b180-4ccf-83b7-ac9d45b35052 for instance 48120777-14d3-4deb-9f45-1146dc41c5c6 on hv-cinder-78638 May 10 17:25:30.971539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-9f7cd893-c345-4c59-b3fc-911f23cbe068 req-e84427e1-dc3f-47d6-9c3b-625345037cdd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185417 May 10 17:25:30.972322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 408/865] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:25:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:25:30.973679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9b89d419-f1df-4f59-9c7e-d191f61d4b5d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.193278 May 10 17:25:30.974573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 458/866] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:30 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:31.027251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:31.028740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:31.036954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:31.037419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:31.038210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:31.038699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:31.416907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:31.426590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ff851e75-5872-401d-a850-c9dc4eae4381 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1512 microversion: 2.1 time: 0.403237 May 10 17:25:31.435500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 409/867] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:31 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:31.985753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:31.987398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:32.002058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:32.002785 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:32.003932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:32.004628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:32.148937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8c44c2c9-29da-4062-9f4e-ae01dae3afa4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.166742 May 10 17:25:32.150248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 459/868] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:31 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 17:25:32.445627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:32.446256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:32.460519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:32.460994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:32.461819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:32.462270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:32.699652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:32.710989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d1fc69c7-30f6-4761-95cd-61a6ad618f63 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1512 microversion: 2.1 time: 0.270283 May 10 17:25:32.712080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 410/869] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:32 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:33.163124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:33.165965 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:33.178670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.179477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.180588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.181195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.330701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-8fb7c86a-51bb-45e7-840a-cab171f71875 req-d89adff3-735b-4d36-8062-5835f9fbee5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6c504f-159b-4fbc-ba80-696d63e34251", "name": "network-vif-deleted", "tag": "f5ff2bc4-4101-4441-8889-11ac99dab78c"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:33.332257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:25:33.332257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:25:33.349836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-8fb7c86a-51bb-45e7-840a-cab171f71875 req-d89adff3-735b-4d36-8062-5835f9fbee5f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.350684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-8fb7c86a-51bb-45e7-840a-cab171f71875 req-d89adff3-735b-4d36-8062-5835f9fbee5f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.371507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0e7f8385-3b06-4078-a878-14e1f8082a6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.212909 May 10 17:25:33.372187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 411/870] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:33 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 17:25:33.384934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-8fb7c86a-51bb-45e7-840a-cab171f71875 req-d89adff3-735b-4d36-8062-5835f9fbee5f service nova] Creating event network-vif-deleted:f5ff2bc4-4101-4441-8889-11ac99dab78c for instance ec6c504f-159b-4fbc-ba80-696d63e34251 on hv-cinder-78638 May 10 17:25:33.389786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-8fb7c86a-51bb-45e7-840a-cab171f71875 req-d89adff3-735b-4d36-8062-5835f9fbee5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277574 May 10 17:25:33.390486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 460/871] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:25:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:25:33.728518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:33.729042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:33.737236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.737729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.738542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.739151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.823370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:33.824310 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:33.824923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lazy-loading 'fault' on Instance uuid ec6c504f-159b-4fbc-ba80-696d63e34251 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:25:33.913668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34a86cc6459b424f8e6dc8b08e7dc5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9cc9feff17427b9609bc260703b774', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:25:33.925552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-47c17fc5-0243-4ae0-8dc6-ce48ab791631 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 200 len: 1309 microversion: 2.1 time: 0.201582 May 10 17:25:33.926413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 412/872] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:33 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:25:34.384006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:34.385115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:34.393066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:34.393648 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:34.394589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:34.395268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:34.525513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7d55b26a-cb26-4189-b5dc-75e50233c6a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.146609 May 10 17:25:34.526385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 461/873] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:34 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:34.942948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:25:34.943493 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] [instance: ec6c504f-159b-4fbc-ba80-696d63e34251] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:34.951329 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:34.951780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:34.952556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:34.952998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:35.002454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] HTTP exception thrown: Instance ec6c504f-159b-4fbc-ba80-696d63e34251 could not be found. May 10 17:25:35.003070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] Returning 404 to user: Instance ec6c504f-159b-4fbc-ba80-696d63e34251 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:25:35.003904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cfd91cdc-0357-4e13-9ec0-65696e7f82a1 tempest-VolumesSnapshotTestJSON-1727878486 tempest-VolumesSnapshotTestJSON-1727878486-project] 10.222.0.32 "GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251" status: 404 len: 111 microversion: 2.1 time: 0.065042 May 10 17:25:35.004607 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 413/874] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:25:34 2021] GET /compute/v2.1/servers/ec6c504f-159b-4fbc-ba80-696d63e34251 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:25:35.537791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:35.538901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:35.546890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:35.547352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:35.548137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:35.548584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:35.668536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3f44d897-cac9-4f67-928a-41958db5ff12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.135211 May 10 17:25:35.669175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 462/875] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:35 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:36.679728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:36.680658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:36.689925 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:36.690741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:36.691687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:36.692369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:36.812792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-419e5fc7-eb7b-4c2c-81f5-2deab686bae2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.136750 May 10 17:25:36.813354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 414/876] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:36 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:37.823803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:37.825005 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:37.833609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:37.834185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:37.835015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:37.835491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:42.205738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ff9e07b3-30c3-40d5-9d61-a0b486907548 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 4.385848 May 10 17:25:42.206635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 463/877] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:37 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 4388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:43.217503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:43.218498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:43.227004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:43.227488 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:43.228306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:43.228839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:43.359302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a6487880-59e5-4a0c-a8f9-e25e3233f949 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.145866 May 10 17:25:43.360110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 415/878] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:43 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:25:44.370286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:44.371537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:44.379600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:44.380820 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:44.381827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:44.382184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:44.521544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-49ef0a59-2710-4acc-8859-97b1e0d4f799 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14 microversion: 2.1 time: 0.155286 May 10 17:25:44.522189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 464/879] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:44 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 17:25:45.538032 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:45.539189 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:45.547013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:45.547498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:45.548284 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:45.548729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:45.687431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8f74962c-4649-4e4a-822f-d3088ac10d32 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 6451 microversion: 2.1 time: 0.153904 May 10 17:25:45.688014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 416/880] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:45 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 6451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:25:46.699480 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:46.700486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:46.708331 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:46.708792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:46.709570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:46.710012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:46.873736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d3552fb1-c6bf-41d3-8218-56a261318b60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 14250 microversion: 2.1 time: 0.178256 May 10 17:25:46.874414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 465/881] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:46 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 14250 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:47.886613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:47.887635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:47.895609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:47.896066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:47.896863 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:47.897304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:48.026637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-301abddb-742a-4867-997b-53942c21ddec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 18083 microversion: 2.1 time: 0.144982 May 10 17:25:48.027203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 417/882] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:47 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 18083 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:49.037988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:49.039033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:49.047054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:49.047516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:49.048309 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:49.048762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:55.000040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b9dc4bc9-0b13-420e-915a-cf305cade3ff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 24003 microversion: 2.1 time: 5.966033 May 10 17:25:55.000684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 466/883] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:49 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 24003 bytes in 5968 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:56.012654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:56.013963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:56.021868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:56.022327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:56.023147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:56.024225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:56.186277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-406a213a-7ae6-4bba-b8d7-f94857b8cd04 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 27417 microversion: 2.1 time: 0.178209 May 10 17:25:56.186974 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 418/884] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:56 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 27417 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:57.198914 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:57.200020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:57.208507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:57.209034 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:57.209887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:57.210446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:57.369335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-05523f03-4f14-4f86-bac1-8f1a78f1b2ea tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 27596 microversion: 2.1 time: 0.175384 May 10 17:25:57.370742 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 467/885] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:57 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 27596 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:58.381843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:58.383807 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:58.392141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:58.392604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:58.393405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:58.393848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:58.530254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4f6a3cb3-05a1-4901-ad7c-2e0b7046a8f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 27784 microversion: 2.1 time: 0.152389 May 10 17:25:58.531063 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 419/886] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:58 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 27784 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:25:59.543491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:25:59.544598 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:25:59.552792 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:59.553259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:59.554057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:25:59.554599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:25:59.693453 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d67592ed-5fe6-4ed8-9ba1-6d1475c86337 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 27895 microversion: 2.1 time: 0.155255 May 10 17:25:59.697308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 468/887] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:25:59 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 27895 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:00.705068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:00.705997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:00.713911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:00.714400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:00.715187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:00.715632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:00.858956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-47a6b853-1fb5-4504-8273-3ede5f319242 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 27946 microversion: 2.1 time: 0.157939 May 10 17:26:00.859645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 420/888] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:00 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 27946 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:01.871784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:01.872827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:01.880703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:01.881160 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:01.881964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:01.882442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:02.026177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4a6ea567-3511-49de-bc4d-47870cc04b4f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28013 microversion: 2.1 time: 0.159020 May 10 17:26:02.030062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 469/889] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:01 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28013 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:03.038175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:03.039725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:03.048120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:03.048891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:03.050228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:03.050328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:03.180710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-eb758c5d-94dd-4b13-85da-43e0afe455b7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.146671 May 10 17:26:03.181402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 421/890] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:03 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:04.192972 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:04.193983 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:04.201985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:04.202493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:04.203281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:04.203731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:09.090535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54318ea7-2e21-440b-b27c-6a3b669fdc70 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 4.901480 May 10 17:26:09.091133 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 470/891] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:04 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 4903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:10.102195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:10.103225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:10.111163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:10.111555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:10.112323 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:10.112762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:10.237484 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bedbbe05-e1c4-47d7-a072-271ad47af9b6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.139977 May 10 17:26:10.238361 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 422/892] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:10 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:11.249716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:11.250918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:11.259999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:11.260579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:11.261470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:11.262012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:11.394737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e650514f-e98d-4a07-8e4f-b70d6f40ad6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.149021 May 10 17:26:11.395421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 471/893] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:11 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:12.407574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:12.408752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:12.417328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:12.417863 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:12.418812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:12.419297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:12.544414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b2bcd181-d6c3-4533-9890-d7c3d6b93712 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.141363 May 10 17:26:12.545072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 423/894] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:12 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:13.557163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:13.558275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:13.566198 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:13.566703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:13.567500 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:13.567953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:13.691444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bfd67889-a291-4557-87cb-6febb27dbf6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.138251 May 10 17:26:13.695410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 472/895] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:13 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:14.703813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:14.704866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:14.713331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:14.713790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:14.714594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:14.715072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:14.852375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-876c77f8-d580-49e6-88a3-de44d58178ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.152612 May 10 17:26:14.853019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 424/896] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:14 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:15.863787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:15.864995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:15.873855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:15.874307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:15.875097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:15.875540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:16.004907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f21c3fa6-6dbd-4d0f-be4c-ccc00f4cc5c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.145189 May 10 17:26:16.009143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 473/897] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:15 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:17.017095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:17.018141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:17.026496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:17.026949 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:17.027723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:17.028165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:17.150933 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-715161b9-9946-4d2b-a075-842bf8a6ade3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.137603 May 10 17:26:17.151589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 425/898] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:17 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:18.162956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:18.164177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:18.173129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:18.173754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:18.174727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:18.175177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:18.429881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8dd1a5dc-a259-4ed9-abe1-77d5779b3b4d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.270880 May 10 17:26:18.431178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 474/899] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:18 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:18.560017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:26:18.560211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:26:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:26:19.442028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:19.443110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:19.451659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:19.452149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:19.452937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:19.453381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:22.515343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b08a7433-4f6f-47ac-a8b0-7afdf7cb7a44 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 3.077324 May 10 17:26:22.516065 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 426/900] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:19 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 3079 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:23.527492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:23.528498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:23.536753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:23.537209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:23.537984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:23.538451 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:23.688202 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-40b159e2-a1ec-429c-9728-98862f1f9fd4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.164834 May 10 17:26:23.688819 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 475/901] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:23 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:24.700789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:24.701805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:24.709597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:24.710058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:24.710868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:24.711316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:24.832154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2cb68355-db65-4e5d-b4bd-72d4e77f7208 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.135983 May 10 17:26:24.832853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 427/902] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:24 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:25.844051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:25.845039 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:25.853128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:25.854086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:25.854890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:25.855335 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:25.982976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a0775415-aa56-4568-b032-613ca51f70b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.142738 May 10 17:26:25.983514 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 476/903] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:25 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:26.995659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:26.996652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:27.004498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:27.004948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:27.005722 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:27.006157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:27.125745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e5ad0c36-3f91-4d3c-b28f-41c4860b04a1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.134531 May 10 17:26:27.126394 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 428/904] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:26 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:28.137866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:28.138924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:28.146809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:28.147264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:28.148038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:28.148481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:28.264932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-48fa7587-c5b8-4438-8fd1-3931199395af tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.131111 May 10 17:26:28.265546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 477/905] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:28 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:29.277327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:29.278356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:29.286291 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:29.286778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:29.287558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:29.288001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:29.408396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-91991d4b-ce1f-4592-b7f6-dd62b4a80197 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.135496 May 10 17:26:29.409500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 429/906] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:29 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:30.421102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:30.422142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:30.430101 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:30.430601 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:30.431442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:30.431944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:30.561746 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ba309a2a-64b8-461e-b594-5fe54b4b0d6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.144782 May 10 17:26:30.562459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 478/907] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:30 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:31.574269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:31.575308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:31.583104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:31.583557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:31.584327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:31.584768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:31.705717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-06ff308b-2f38-427d-820d-b0eab4878783 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.135492 May 10 17:26:31.706357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 430/908] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:31 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:32.717767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:32.718826 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:32.727015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:32.727481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:32.728269 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:32.729237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:35.475433 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-57617864-9e31-4a6b-aa5c-e7e2941491ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 2.761642 May 10 17:26:35.476407 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 479/909] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:32 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 2764 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:36.488172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:36.489185 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:36.497641 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:36.498101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:36.498909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:36.499354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:36.616157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4dc4fa9d-a274-4a8c-8a65-530fb628eeba tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.132007 May 10 17:26:36.619994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 431/910] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:36 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:26:37.627426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:37.628936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:37.636456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:37.636915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:37.637698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:37.638171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:37.765261 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d4da6754-9c81-4032-b7cc-a8be49c87405 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.141839 May 10 17:26:37.769074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 480/911] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:37 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:38.777603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:38.778672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:38.788535 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:38.789002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:38.789816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:38.790247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:38.915174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7d1ce887-e991-4045-b9dd-76aa7f7d64ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28130 microversion: 2.1 time: 0.141759 May 10 17:26:38.915741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 432/912] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:38 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28130 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:39.927778 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:39.928858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:39.936697 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:39.937157 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:39.937946 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:39.938428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:40.060894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-201a8f89-aef3-4e1c-a48f-b8ca4eb8ec89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28421 microversion: 2.1 time: 0.137129 May 10 17:26:40.061540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 481/913] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:39 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28421 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:41.073066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:41.074110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:41.081879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:41.082331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:41.083283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:41.083725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:41.210375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-18e360f9-080e-49b0-aba8-c9b1e3cac27f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28492 microversion: 2.1 time: 0.141272 May 10 17:26:41.211202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 433/914] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:41 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28492 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:42.222472 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:42.223517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:42.232221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:42.232686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:42.233469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:42.233917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:42.358949 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-449f7b6f-4c7d-4ef5-8004-ce7af7c9d23f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.140538 May 10 17:26:42.359561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 482/915] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:42 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:43.371911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:43.372928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:43.380757 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:43.381215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:43.382005 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:43.382481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:43.521556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-21356fe0-4c34-44f7-a399-1ca04382b65f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.154150 May 10 17:26:43.522133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 434/916] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:43 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:44.534953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:44.535980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:44.544031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:44.544484 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:44.545280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:44.545735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:44.682673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-419cb2a4-557a-4c73-9ba4-07312117ba68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.152133 May 10 17:26:44.683628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 483/917] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:44 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:26:45.695545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:45.697419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:45.706105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:45.706603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:45.707406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:45.707859 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:45.826120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ed3f7a25-cf13-4d07-b5fe-1f7f4f5d6e57 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.134428 May 10 17:26:45.827498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 435/918] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:45 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:46.839840 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:46.841231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:46.850135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:46.851057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:46.852068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:46.852605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:46.983113 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fcde5048-bae1-4dd3-adee-1fc9e6003cf1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.147580 May 10 17:26:46.984296 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 484/919] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:46 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:47.995364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:47.997017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:48.007594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:48.008369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:48.009464 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:48.010069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:48.136659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ac22d985-ae92-46ea-bafc-505a1a5384e4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.144945 May 10 17:26:48.137238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 436/920] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:47 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:49.149610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:49.151292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:49.159247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:49.159934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:49.160734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:49.161342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:49.289102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54029d86-905f-4fa1-806d-a6c87b779cf8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.143615 May 10 17:26:49.290032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 485/921] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:49 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:26:50.301548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:50.302675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:50.315881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:50.316459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:50.317615 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:50.318164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:50.463287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c8818c4c-4ede-445f-92ca-83243bd631a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.165572 May 10 17:26:50.464645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 437/922] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:50 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:51.477033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:51.479686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:51.490974 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:51.491560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:51.492597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:51.493244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:51.631900 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3e69687d-cd38-4c71-a3fa-5d69084a709f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.160027 May 10 17:26:51.632750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 486/923] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:51 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:52.645153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:52.646083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:52.657864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:52.658318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:52.661009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:52.661462 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:52.853808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-21d5ba8b-2996-47ed-9045-badf96b265f5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.212785 May 10 17:26:52.855283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 438/924] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:52 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:53.866035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:53.867678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:53.877474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:53.878196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:53.879195 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:53.879834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:54.023612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-15ff57bb-a79c-4e87-b8b6-ba1ec52ac729 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.161862 May 10 17:26:54.024280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 487/925] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:53 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:55.039635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:55.041731 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:55.055092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:55.056583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:55.056583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:55.056809 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:55.177701 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8394014a-5cb6-4c6d-bc5c-8dcd0c8110e1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.145321 May 10 17:26:55.178585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 439/926] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:55 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:56.190967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:56.192273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:56.201063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:56.201662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:56.202721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:56.203412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:56.337684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ba4adbe8-62ca-430c-9c5e-b176b035039d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.151386 May 10 17:26:56.339018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 488/927] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:56 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:57.356524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:57.363285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:57.382668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:57.383159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:57.383969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:57.384426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:57.532458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-07bcb217-0c86-4482-990b-2d9fb580485f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.184057 May 10 17:26:57.533572 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 440/928] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:57 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:58.543945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:58.544971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:58.553547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:58.554241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:58.555064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:58.555514 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:58.683567 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-720e8435-4cda-4547-9df0-4bf2a78322eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.142901 May 10 17:26:58.685021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 489/929] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:58 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:26:59.696533 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:26:59.697486 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:26:59.706310 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:59.706802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:59.707803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:26:59.708450 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:26:59.841860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-460ef806-6532-4f43-b598-16d3f2d026a9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.150069 May 10 17:26:59.843293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 441/930] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:26:59 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:00.854647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:00.855685 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:00.863728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:00.864501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:00.865615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:00.866264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:01.004102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-659e6d0f-5ff0-4d80-9598-fb61fb837570 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.153720 May 10 17:27:01.004763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 490/931] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:00 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:02.017699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:02.018761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:02.039624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:02.040482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:02.041632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:02.042321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:02.204547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ff028f65-b4b8-451b-b22e-6aa572afcb6c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.191266 May 10 17:27:02.208603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 442/932] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:02 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:03.220201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:03.221214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:03.231001 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:03.231849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:03.232856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:03.233303 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:03.354070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3c69fbe5-773b-4ee9-b21c-97035af18fc7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.137688 May 10 17:27:03.354817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 491/933] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:03 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:04.367761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:04.369340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:04.382064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:04.382808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:04.383947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:04.384618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:04.544978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b928b9b9-2ac2-4519-80f5-b558667fb909 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.178923 May 10 17:27:04.546986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 443/934] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:04 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:05.284470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:05.285019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:05.293059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.293850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.294923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.295443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.364612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ba4a4f24-97fb-4fb2-bfb0-f63a21ae813f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments/04891ab0-8b42-4274-ae16-1849c359ddfd" status: 200 len: 194 microversion: 2.20 time: 0.084256 May 10 17:27:05.365251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 492/935] 10.222.0.32 () {60 vars in 1454 bytes} [Mon May 10 17:27:05 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments/04891ab0-8b42-4274-ae16-1849c359ddfd => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:05.478768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:05.481493 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:05.490251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.490744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.491563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.492013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.555190 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:05.556255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:05.566465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.567163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.568234 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:05.568571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:05.677644 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lazy-loading 'services' on Instance uuid 9ac86cf8-f933-474a-9e63-aef9cd2041d0 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:27:05.692926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e2674fa9-a1fc-4499-9a59-97c22f180191 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.141552 May 10 17:27:05.700237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 493/936] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:05 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:05.826995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8ebab3ad-d4f2-4099-b48e-36e27612c47a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments/04891ab0-8b42-4274-ae16-1849c359ddfd" status: 202 len: 0 microversion: 2.20 time: 0.352781 May 10 17:27:05.827776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 444/937] 10.222.0.32 () {60 vars in 1457 bytes} [Mon May 10 17:27:05 2021] DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0/os-volume_attachments/04891ab0-8b42-4274-ae16-1849c359ddfd => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:27:06.224662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'create', calling method: .version_select at 0x7f4145316d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1303517117"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:06.249042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for project 51cd3a26242746e0abb60baf938aae7f. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:06.252868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for user a4013ea2076f458d9ccfc0c90e685093 and project 51cd3a26242746e0abb60baf938aae7f. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:06.507933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for project 51cd3a26242746e0abb60baf938aae7f. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:06.512319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for user a4013ea2076f458d9ccfc0c90e685093 and project 51cd3a26242746e0abb60baf938aae7f. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:06.525018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1d357cab-6202-4613-87bd-73acd9c782a4 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.304549 May 10 17:27:06.525623 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 494/938] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 10 17:27:06 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:06.579387 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1626176651", "imageRef": "91a2793d-1559-4bdd-9570-05d7dfaf8c18", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1303517117", "networks": [{"uuid": "e30340b3-1127-442e-a9fd-0f2e95971614"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:06.643015 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] validate_networks() for [('e30340b3-1127-442e-a9fd-0f2e95971614', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:27:06.705295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:06.706411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:06.713965 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:06.714467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:06.715258 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:06.715705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:06.836636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-61a9ae8b-e7ee-4b13-88ce-1ac077c9e95b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.135001 May 10 17:27:06.840718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 495/939] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:06 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:27:07.069644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:07.070440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:07.079287 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.079810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.080675 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.081191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.141891 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:27:07.209419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:27:07.209982 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:27:07.210541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:27:07.210986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:27:07.211452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:27:07.220658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.221121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.221946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.222422 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.252846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for project 51cd3a26242746e0abb60baf938aae7f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:07.253363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ab109324-2974-4258-a813-cc1099230a53 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 204 len: 0 microversion: 2.20 time: 0.188375 May 10 17:27:07.254145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 496/940] 10.222.0.32 () {60 vars in 1280 bytes} [Mon May 10 17:27:07 2021] DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:27:07.260593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Getting quotas for user a4013ea2076f458d9ccfc0c90e685093 and project 51cd3a26242746e0abb60baf938aae7f. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:07.262683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:07.263387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:07.270951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.271343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:27:07.271486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.272175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.272616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.273750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91a2793d-1559-4bdd-9570-05d7dfaf8c18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:27:07.319241 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-387e8f11-37b5-446e-8fd9-3162b4b295de tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744387 May 10 17:27:07.320439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 445/941] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:27:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:27:07.330246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-51e0dfc4-bf3f-4960-9b84-486a87956513 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:07.331150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-51e0dfc4-bf3f-4960-9b84-486a87956513 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:07.433611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-51e0dfc4-bf3f-4960-9b84-486a87956513 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:07.441892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-51e0dfc4-bf3f-4960-9b84-486a87956513 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1259 microversion: 2.1 time: 0.115755 May 10 17:27:07.451031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 446/942] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:07 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1259 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:07.518610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:07.528555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:07.530089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:07.531263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f122f9cf-0617-4b53-8232-a7610baaf3e3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.272795 May 10 17:27:07.531809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 497/943] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:07 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:07.848706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:07.849716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:07.857476 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.857996 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:07.858812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:07.859256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:08.012745 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-aacb06ac-24c1-46de-96e8-e44c2633fe51 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 28589 microversion: 2.1 time: 0.167765 May 10 17:27:08.016921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 447/944] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:07 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 28589 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:08.458878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:08.459681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:08.468108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:08.468701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:08.469876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:08.470483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:08.550861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:08.551738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:08.560399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:08.561011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:08.561959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:08.562448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:08.599496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:08.610324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4dbddd6d-9492-48c0-9b37-ae04cf984d0d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1319 microversion: 2.1 time: 0.155509 May 10 17:27:08.611646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 498/945] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:08 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:08.771313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:08.780750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:08.782263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:08.783420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-46e32522-fb9a-425d-acf6-22721e0b3cbd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.237015 May 10 17:27:08.783986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 448/946] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:08 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:09.024933 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:09.026771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:09.047505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.049984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:09.051823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.052858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:09.627495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:09.628688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:09.636403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.636863 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:09.637739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.638183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:09.878054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:09.886797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-708f946f-15a7-4cab-ac8b-40b8d281a264 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.263064 May 10 17:27:09.887362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 449/947] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:09 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:09.891630 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:09.892242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:09.899594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.900054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:09.900842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:09.901930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:10.113046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:10.122126 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:10.123776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:10.124919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4f7bb5de-2995-416b-b291-fe8ec3e1050e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.236628 May 10 17:27:10.125472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 450/948] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:09 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:10.903964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:10.905672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:10.914500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:10.914954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:10.915775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:10.916236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:11.117449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:11.125600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-29c6d61d-53b1-46fa-bbb4-0b619f1515f6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.226488 May 10 17:27:11.126173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 451/949] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:10 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:11.142973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:11.143589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:11.150843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:11.151877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:11.152710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:11.153204 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:11.359897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:11.368884 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:11.370455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:11.371622 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dcc76751-c4d4-4a57-aa22-ae5b85b218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.232073 May 10 17:27:11.382153 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 452/950] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:11 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:12.142616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:12.143382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:12.151355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:12.151808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:12.152752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:12.153197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:12.364428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:12.373067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dbd5331c-d45a-4916-8ca1-b8950cb11da0 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.234602 May 10 17:27:12.373629 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 453/951] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:12 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:12.388324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:12.388930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:12.396064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:12.396465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:12.397246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:12.397686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:12.607455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:12.616133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:12.617645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:12.618812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7eea72c1-cf9e-4807-8b27-5c8dab38b799 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.233914 May 10 17:27:12.619364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 454/952] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:12 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:13.390626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:13.391545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:13.399181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:13.399636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:13.400424 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:13.400866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:13.618565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:13.626719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-08246bc0-45fa-4d3b-9ff2-c5e68fab1452 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.241318 May 10 17:27:13.627293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 455/953] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:13 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:13.637049 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:13.637660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:13.644778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:13.645176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:13.645957 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:13.646430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:13.942104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:13.952388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:13.953930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:13.955117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-513f0912-d6c7-404d-bd09-7a545c3c283f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.322155 May 10 17:27:13.955685 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 456/954] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:13 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:14.643223 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:14.643912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:14.651250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:14.651708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:14.652490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:14.652935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:14.852646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:14.861553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d42c76cd-a816-4cc7-94e2-e947385dbcf3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.222046 May 10 17:27:14.862121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 457/955] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:14 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:14.974318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:14.974876 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:14.983078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:14.983531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:14.984309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:14.984749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:15.193515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:15.202205 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:15.203758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:15.204882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8af62aa9-27b5-4345-b02f-4d7c54c6123b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.234518 May 10 17:27:15.205434 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 458/956] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:14 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:15.878679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:15.879331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:15.886775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:15.887239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:15.888698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:15.889136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:16.086911 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:16.095105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-991ed703-acf7-480e-ae83-033d58c005f5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.220140 May 10 17:27:16.095672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 459/957] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:15 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:16.223056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:16.223812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:16.232853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:16.233311 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:16.234131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:16.234597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:16.443924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:16.454539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:16.456301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:16.457716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-282f0ad3-3683-4716-89cf-666ec14bf609 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.238539 May 10 17:27:16.458679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 460/958] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:16 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:17.112341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:17.113191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:17.120499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:17.120951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:17.121735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:17.122182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:17.329505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:17.337823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-29ca12f8-cefe-41a5-b91c-4a75e63cbc3c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.229336 May 10 17:27:17.338441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 461/959] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:17 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:17.477272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:17.478531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:17.487792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:17.488732 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:17.489929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:17.490405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:17.696333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:17.705416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:17.707181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:17.708711 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-04229e4d-d823-4eff-9403-3cec9973d56f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.236423 May 10 17:27:17.710874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 462/960] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:17 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:18.012614 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:18.013192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:18.020575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.021039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.021815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.022258 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.080559 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lazy-loading 'flavor' on Instance uuid 261e9b77-db9a-4a51-bd06-480d1bff4a79 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:27:18.228496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4aff1fe3-be90-4236-a670-ecbcd28e2d18 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "POST /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79/action" status: 202 len: 0 microversion: 2.1 time: 0.219438 May 10 17:27:18.232931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 463/961] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:18 2021] POST /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:27:18.238204 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:18.239043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:18.246883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.247492 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.248551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.249002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.534228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:18.543878 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a92df624-c007-4a70-9571-9c905e58bacf tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.309643 May 10 17:27:18.544600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 464/962] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:18 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:18.549363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:18.550132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:18.557278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.557739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.558569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.559021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.756269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:18.766297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3901c3d3-341b-4e0a-85da-0320e49b8d9f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.220422 May 10 17:27:18.766921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 465/963] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:18 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:18.775528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:18.775528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:18.781312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.781793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:18.782705 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:18.783148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:19.003065 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:19.012369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:19.014732 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:19.015927 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d360117a-3344-4a91-9d7a-55f53d727607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.247912 May 10 17:27:19.016490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 466/964] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:18 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:19.561264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:19.562054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:19.569194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:19.571220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:19.572019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:19.572466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:19.938221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:19.946510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e423e469-502f-49cd-8f95-49ce5f40812d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.389586 May 10 17:27:19.947079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 467/965] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:19 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:19.952190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:19.952806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:19.959531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:19.959990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:19.960771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:19.961216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:20.167246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:20.175969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1d3902b8-be22-4ad1-bf74-2fa7ba92aaea tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.227819 May 10 17:27:20.176638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 468/966] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:19 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:20.181052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:20.181748 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:20.189220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:20.189770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:20.190657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:20.191173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:20.391375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:20.400861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:20.402654 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:20.403799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-340d74a8-79cf-4f99-8cfb-f01d93eddaf2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.226162 May 10 17:27:20.404360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 469/967] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:20 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:20.963978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:20.964776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:20.971883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:20.972333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:20.973133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:20.973573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:21.170906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:21.179690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1667e3e9-0dd8-490b-94c5-450f0ca8bb63 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.219328 May 10 17:27:21.180308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 470/968] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:20 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:21.191833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:21.192540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:21.201158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:21.201611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:21.202413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:21.202853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:21.393348 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:21.401366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-44b656b8-4a58-4e02-99bf-60777c62a5be tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.213207 May 10 17:27:21.401923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 471/969] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:21 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:21.421334 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:21.421936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:21.428802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:21.429255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:21.430031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:21.430505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:21.629997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:21.639410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:21.641026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:21.642173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1105c72c-7fde-47f3-8791-2cc96648dc34 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.224785 May 10 17:27:21.642760 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 472/970] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:21 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:22.195914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:22.196514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:22.203778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.204235 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.205001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.205444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.476900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:22.485584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0371c994-1a31-40e3-bf10-cc5040a5d0d3 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.293566 May 10 17:27:22.486149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 473/971] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:22 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:22.490506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:22.491119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:22.498432 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.498883 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.499655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.500100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.692033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:22.700166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-613972f6-f61f-41f4-8818-ce39666c8657 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.212994 May 10 17:27:22.700724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 474/972] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:22 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:22.705064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:22.705671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:22.712504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.712957 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.713735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:22.714172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:22.909749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:22.920790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:22.922357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:22.923507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4fb00265-2b3f-4b53-abb4-262e6d1d4732 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.221851 May 10 17:27:22.924067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 475/973] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:22 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:23.503007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:23.503696 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:23.511026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.511486 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:23.512272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.513401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:23.708081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:23.716436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7a8eb500-64b1-4cda-8496-ce7246f3c27b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.217220 May 10 17:27:23.717002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 476/974] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:23 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:23.721333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:23.721939 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:23.728861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.729315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:23.730084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.730551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:23.923966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:23.932303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-94a8d33d-442a-4320-89a6-c9fed0a17c7f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.214280 May 10 17:27:23.933158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 477/975] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:23 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:23.941033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:23.941645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:23.949280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.949776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:23.950683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:23.951344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:24.146988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:24.156385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:24.157913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:24.159088 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8688ca27-73cb-4018-abea-d8d3adb60052 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.221654 May 10 17:27:24.159645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 478/976] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:23 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:24.485845 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7b459701-c193-4dd3-b560-657610d1d8c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 38115 microversion: 2.1 time: 15.464460 May 10 17:27:24.486925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 499/977] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:09 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 38115 bytes in 15466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:24.909124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:24.909759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:24.916990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:24.917443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:24.918226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:24.918720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:24.950015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:24.951591 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:24.961414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:24.962156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:24.963225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:24.964052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.365566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:25.374692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dfa0adab-6e4c-4a2e-a642-37ba61aa414e tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.645257 May 10 17:27:25.375386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 479/978] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:24 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:25.389723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:25.390453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:25.413423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:25.415512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.420015 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:25.420706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.430478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:25.439584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f1b633a7-bb16-4eca-8547-b3feee6488b7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.494217 May 10 17:27:25.442770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 500/979] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:24 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:25.448788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-2e0834dc-f723-4732-b214-cca12ce67697 req-efb49452-9dfc-4b8d-9700-0e135dda438f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:25.450715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:25.450715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:27:25.477745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-2e0834dc-f723-4732-b214-cca12ce67697 req-efb49452-9dfc-4b8d-9700-0e135dda438f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:25.478366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-2e0834dc-f723-4732-b214-cca12ce67697 req-efb49452-9dfc-4b8d-9700-0e135dda438f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.498571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-2e0834dc-f723-4732-b214-cca12ce67697 req-efb49452-9dfc-4b8d-9700-0e135dda438f service nova] Creating event network-changed:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:27:25.504302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-2e0834dc-f723-4732-b214-cca12ce67697 req-efb49452-9dfc-4b8d-9700-0e135dda438f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059310 May 10 17:27:25.505166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 501/980] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:25.510835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:25.512163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:25.519967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:25.520732 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.521771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:25.525907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:25.665885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-07716276-e898-48e2-9e0d-36130d35c85e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 38115 microversion: 2.1 time: 0.159022 May 10 17:27:25.666569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 502/981] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:25 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 38115 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:25.910656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:25.920989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:25.922943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:25.924453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e2424f7c-c87e-40d9-83b4-8abaf9a7f745 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1724 microversion: 2.20 time: 0.539065 May 10 17:27:25.935924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 480/982] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:25 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1724 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:26.392642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:26.393605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:26.402278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.403036 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.403816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.404435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.457190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:26.458089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:26.466374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.467146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.468195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.469098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.846881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:26.859239 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7cbafd24-e275-4045-9336-2e78c55bcd07 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.471308 May 10 17:27:26.860076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 503/983] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:26 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:26.865563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:26.866874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:26.876424 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.876913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.877993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.878677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.908538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:26.918372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cbc4e1ae-0359-4962-be3c-e9befa87cb95 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.464794 May 10 17:27:26.921074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 481/984] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:26 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:26.932821 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-7d167c12-4244-4667-9cda-5013030988c6 req-94e04c8a-0514-4f1b-b4a6-65931037c8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac86cf8-f933-474a-9e63-aef9cd2041d0", "name": "network-vif-deleted", "tag": "a36caa3d-c0a8-46d5-8981-e9e734cd45b6"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:26.935306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:26.935306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:26.945655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7d167c12-4244-4667-9cda-5013030988c6 req-94e04c8a-0514-4f1b-b4a6-65931037c8c3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.946460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7d167c12-4244-4667-9cda-5013030988c6 req-94e04c8a-0514-4f1b-b4a6-65931037c8c3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.963396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-7d167c12-4244-4667-9cda-5013030988c6 req-94e04c8a-0514-4f1b-b4a6-65931037c8c3 service nova] Creating event network-vif-deleted:a36caa3d-c0a8-46d5-8981-e9e734cd45b6 for instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 on hv-cinder-78638 May 10 17:27:26.969878 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-7d167c12-4244-4667-9cda-5013030988c6 req-94e04c8a-0514-4f1b-b4a6-65931037c8c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047415 May 10 17:27:26.970788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 482/985] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:26.985923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:26.987009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:26.996152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.997480 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:26.998754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:26.999356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:27.055736 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c5868ed0-bebd-4b62-80bd-627053452249 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 38115 microversion: 2.1 time: 0.194028 May 10 17:27:27.057323 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 504/986] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:26 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 38115 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:27.089512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:27.090227 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:27.091482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lazy-loading 'fault' on Instance uuid 9ac86cf8-f933-474a-9e63-aef9cd2041d0 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:27:27.168002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:27.177416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:27.178991 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:27.180226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cc287ee2-3887-4dea-9990-b87c3a3967aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 200 len: 1372 microversion: 2.20 time: 0.200561 May 10 17:27:27.180827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 483/987] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:26 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:27.878183 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:27.879043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:27.888579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:27.889143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:27.890008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:27.890715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:27.937203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:27.938042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:27.945591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:27.946148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:27.946971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:27.947417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.202409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:28.219921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e32e70d6-7b2a-4d0a-9722-5300500880ac tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.345572 May 10 17:27:28.222028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:28.223262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 505/988] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:27 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:28.231756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:28.233023 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:28.233953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dff0cbd3-a6bf-4eb5-9c3f-cd36281daf20 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.301012 May 10 17:27:28.235445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 484/989] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:27 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:28.240498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:28.241116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:28.243003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.243647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.244611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.245217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.249350 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.250101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.251009 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.251526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.307679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. May 10 17:27:28.308584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:27:28.309656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8338bf9b-2f31-418a-aa3d-fa90ecfcabc9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 404 len: 111 microversion: 2.20 time: 0.073054 May 10 17:27:28.310603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 485/990] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:28 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:27:28.319598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-40fadfc2-3417-44d0-a511-d26e89ac6ddf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '.version_select at 0x7f4144905160>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:28.339063 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-40fadfc2-3417-44d0-a511-d26e89ac6ddf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664216596" status: 204 len: 0 microversion: 2.20 time: 0.023086 May 10 17:27:28.339595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 486/991] 10.222.0.32 () {60 vars in 1262 bytes} [Mon May 10 17:27:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664216596 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:27:28.401225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c6ab5ca7-8412-4c66-9613-284e1efc64ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 200 len: 38244 microversion: 2.1 time: 0.176386 May 10 17:27:28.401887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 506/992] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:28 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 38244 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:28.412313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:28.412843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:28.420736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.421197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.421979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:28.422458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:28.482556 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-30aa2caf-0961-4301-9bf0-b2fc00ad639c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/ips" status: 200 len: 146 microversion: 2.1 time: 0.073860 May 10 17:27:28.486432 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 487/993] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:27:28 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/ips => generated 146 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:29.239597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:29.240319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:29.249288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:29.249863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:29.250807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:29.251141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:29.251602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:29.251764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:29.258964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:29.259421 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:29.260676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:29.261152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:29.614716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:29.617737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:29.623030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-865c07d9-23c6-4ff4-bfc2-36b2bc582e41 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.387653 May 10 17:27:29.623635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 507/994] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:29 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:29.628092 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: .version_select at 0x7f41452388b0>, body: {"keypair": {"name": "tempest-keypair-2114086752"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:29.629771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6a80301a-60fe-4370-aa6e-72e5759481ad tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.383315 May 10 17:27:29.630754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 488/995] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:29 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:29.657553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:29.661572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:29.934662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:29.938304 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:29.951521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-209f8c70-9975-4a0d-afd7-168b1a39033e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.326894 May 10 17:27:29.952127 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 508/996] 10.222.0.32 () {62 vars in 1199 bytes} [Mon May 10 17:27:29 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 328 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 10 17:27:30.641160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:30.641780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:30.647296 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:30.647928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:30.649562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:30.650080 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:30.650973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:30.651577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:30.655851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:30.656312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:30.657098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:30.657548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:30.973750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:30.978139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:30.984895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-77771229-7f07-441b-bc52-b48797ad3626 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.341747 May 10 17:27:30.995487 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 509/997] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:30 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:31.003901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f044c33f-c03b-46ad-947c-c3ec98c26c82 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.366833 May 10 17:27:31.008033 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d51a88b-a8fc-4c4f-9193-1c6b1c66f976"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:31.009416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:31.014033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 489/998] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:30 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:31.019122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:31.020072 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:31.020913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:31.021365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:31.396096 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-93d31ff0-72d5-46a8-81ed-3653c57b870f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393353 May 10 17:27:31.396655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 510/999] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:27:31 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:27:31.637156 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1226720559", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a743af2b-ecde-4507-a08d-7e8e82f84011"}], "security_groups": [{"name": "tempest-securitygroup--741864622"}], "key_name": "tempest-keypair-2114086752", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:31.765856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] validate_networks() for [('a743af2b-ecde-4507-a08d-7e8e82f84011', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:27:32.002261 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:32.003614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:32.015305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.016188 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.017563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.018228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.387074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:32.395454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-478ba3b1-5594-46cc-ace4-d3668cfa5ec6 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.397531 May 10 17:27:32.396027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 511/1000] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:31 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:32.405018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:32.405018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:32.409640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.409773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:27:32.410102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.410215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:27:32.410672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:27:32.410928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.411095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:27:32.411380 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.411520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:27:32.420472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.420923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.421740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.422204 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.439371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for project acb915c4b01148a7b37b3577f122af21. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:27:32.443397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Getting quotas for user d07c4ff6a47645d184b80d15a81d77d4 and project acb915c4b01148a7b37b3577f122af21. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:27:32.453918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:27:32.456286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:27:32.501620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-37b24e93-9981-4f59-ad0b-869a7affaa93 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.868616 May 10 17:27:32.502165 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 490/1001] 10.222.0.32 () {62 vars in 1188 bytes} [Mon May 10 17:27:31 2021] POST /compute/v2.1/servers => generated 401 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 17:27:32.581355 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-917ff17d-4c6b-415c-95ca-d7729c2ee9f4 req-8965b565-09ab-4606-ab16-f1549e7a2a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "name": "network-vif-plugged", "status": "completed", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:32.582919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:32.582919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:32.594057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-917ff17d-4c6b-415c-95ca-d7729c2ee9f4 req-8965b565-09ab-4606-ab16-f1549e7a2a51 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:32.594736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-917ff17d-4c6b-415c-95ca-d7729c2ee9f4 req-8965b565-09ab-4606-ab16-f1549e7a2a51 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:32.613606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-917ff17d-4c6b-415c-95ca-d7729c2ee9f4 req-8965b565-09ab-4606-ab16-f1549e7a2a51 service nova] Creating event network-vif-plugged:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:27:32.621972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-917ff17d-4c6b-415c-95ca-d7729c2ee9f4 req-8965b565-09ab-4606-ab16-f1549e7a2a51 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118428 May 10 17:27:32.622764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 491/1002] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:32.628107 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:32.628823 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:32.761301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:32.771433 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:32.774548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:32.775971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-33c37797-8fb1-4463-a760-6166f59193ee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1282 microversion: 2.20 time: 0.151986 May 10 17:27:32.777060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 492/1003] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:32 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:32.780765 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:32.789437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f069fa4f-535b-41cb-8ae4-9726b1f62be6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.392384 May 10 17:27:32.790239 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 512/1004] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:32 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:33.412437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:33.413061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:33.421520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.421976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.422798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.423247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.615866 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:33.624658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8db5cbbc-9d38-4852-84d8-e4a68fe6aa53 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1359 microversion: 2.1 time: 0.216002 May 10 17:27:33.625228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 493/1005] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:33 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:33.795549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:33.796218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:33.804013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.804492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.805501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.805960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.808810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:33.810090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:33.817326 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.817784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.818606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:33.819057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:33.961766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:33.971214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:33.973405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:33.974604 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8c5439a5-d6bb-4642-9c13-e55720672d39 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1334 microversion: 2.20 time: 0.184110 May 10 17:27:33.978187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 513/1006] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:33 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:34.067036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:34.076176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c204a18d-b959-4577-b892-1fd8eaa8a84b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.271053 May 10 17:27:34.076769 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 494/1007] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:33 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:34.641882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:34.642628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:34.650317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:34.650807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:34.651625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:34.652065 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:34.853788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:34.862406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-87276771-74a4-4a75-a2de-b7d461df1ce7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1549 microversion: 2.1 time: 0.225135 May 10 17:27:34.870513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 514/1008] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:34 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:34.878532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:34.879158 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:34.886381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:34.887051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:34.888567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:34.889567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:34.993275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:34.994140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:35.004627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.005517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.006752 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.007412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.423231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.434994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-37470723-f3d7-4161-b8de-9775d66de9b5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1549 microversion: 2.1 time: 0.559543 May 10 17:27:35.445700 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 495/1009] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:34 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1549 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:35.451052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:35.451897 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:35.459169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.459842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.460642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.461082 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.470049 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.480768 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.482819 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.484311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fc55ac3d-f271-4902-a3b6-055007ae11f8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.495118 May 10 17:27:35.485600 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 515/1010] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:34 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:35.507892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:35.514006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:35.514006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:27:35.515701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.517256 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Searching by: {'deleted': False, 'project_id': '51cd3a26242746e0abb60baf938aae7f'} {{(pid=92810) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 10 17:27:35.526015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.527350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.528428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.529111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.625363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.multi_cell_list [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=92810) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 10 17:27:35.718324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-38b24502-10bb-48b0-8965-f7d8765eb001 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.215831 May 10 17:27:35.720450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 516/1011] 10.222.0.32 () {58 vars in 1125 bytes} [Mon May 10 17:27:35 2021] GET /compute/v2.1/servers => generated 343 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:35.730070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:35.730729 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:35.738317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.738811 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.739618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:35.740068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:35.807799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:35.820210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d37a858f-cdf1-444a-9bc2-7d6a3cfc65ba tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.372874 May 10 17:27:35.820981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 496/1012] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:35 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:36.085689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:36.094686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-66565c42-dd08-4387-ad62-08c476b98bd3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1549 microversion: 2.1 time: 0.368385 May 10 17:27:36.095293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 517/1013] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:35 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1549 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:36.218706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-3d359bf9-f2dc-4161-8b8b-7567b7ddf477 req-2eb79604-518b-415b-93a5-f17a05c9ae81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:36.220312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:36.220312 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:36.231424 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-3d359bf9-f2dc-4161-8b8b-7567b7ddf477 req-2eb79604-518b-415b-93a5-f17a05c9ae81 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:36.232127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-3d359bf9-f2dc-4161-8b8b-7567b7ddf477 req-2eb79604-518b-415b-93a5-f17a05c9ae81 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:36.251202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-3d359bf9-f2dc-4161-8b8b-7567b7ddf477 req-2eb79604-518b-415b-93a5-f17a05c9ae81 service nova] Creating event network-changed:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:27:36.263269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-3d359bf9-f2dc-4161-8b8b-7567b7ddf477 req-2eb79604-518b-415b-93a5-f17a05c9ae81 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047474 May 10 17:27:36.263885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 497/1014] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:36.502964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:36.503585 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:36.513509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:36.513971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:36.514812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:36.515260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:36.809816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:36.818868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:36.820415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:36.821496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1f4c25f0-c3fd-4b74-b471-3076d47c4b57 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.322263 May 10 17:27:36.822051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 518/1015] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:36 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:36.837459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:36.838169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:36.846073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:36.846570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:36.847362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:36.847805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:37.055515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:37.064372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d9076e7d-e177-4234-b649-508384336b1a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.231045 May 10 17:27:37.065106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 498/1016] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:36 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:37.838191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:37.838984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:37.846359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:37.846833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:37.847625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:37.848080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:37.879903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:37.881023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:37.888817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:37.889370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:37.890450 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:37.891238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:38.055118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:38.065109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:38.066689 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:38.067794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-947ca318-6c8c-4885-b2a4-4b25159f0203 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.233391 May 10 17:27:38.068362 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 519/1017] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:37 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:38.080762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:38.081555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:38.089569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:38.090021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:38.090873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:38.091313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:38.301775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:38.310861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3b26a7e7-b600-4ba8-b3a6-0ffbf50ab1a2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.233770 May 10 17:27:38.311442 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 520/1018] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:38 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:38.323183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0b4c77c2-36fd-4e37-8070-e69766188aae tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446949 May 10 17:27:38.326377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 499/1019] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:27:37 2021] POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:27:39.085083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:39.085710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:39.093490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.093961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.094789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.095245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.258276 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-eb62d121-f503-4a9a-a73b-184b1c54d8fa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:39.267669 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb62d121-f503-4a9a-a73b-184b1c54d8fa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.268134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-eb62d121-f503-4a9a-a73b-184b1c54d8fa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.294738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:39.303825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:39.305403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:39.306512 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-edde6764-dcc3-4513-a459-4e106eec7b14 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.225318 May 10 17:27:39.307077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 521/1020] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:39 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:39.323505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-eb62d121-f503-4a9a-a73b-184b1c54d8fa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Going to try to stop instance {{(pid=92809) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 10 17:27:39.328700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:39.329470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:39.336885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.337345 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.338126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.338611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.397598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-eb62d121-f503-4a9a-a73b-184b1c54d8fa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.143735 May 10 17:27:39.398776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 500/1021] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:39 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:27:39.406775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:39.407478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:39.415643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.416058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.416854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.417298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.591643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:39.600027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-912cca93-b48c-420a-846e-991ed844a3aa tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1509 microversion: 2.1 time: 0.275398 May 10 17:27:39.600609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 522/1022] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:39 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:39.616557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:39.617082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:39.624211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.624661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.625443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.625881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.665459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:39.674770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-278621fd-2145-4f7f-b813-5e537e104600 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.272121 May 10 17:27:39.675340 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 501/1023] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:39 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:39.770271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a178c136-3a7f-45fd-b8ec-53dd3be017c2 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "POST /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79/action" status: 202 len: 0 microversion: 2.1 time: 0.157246 May 10 17:27:39.770920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 523/1024] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:39 2021] POST /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:27:39.779358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:39.779992 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:39.787263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.787723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.788521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:39.788970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:39.991089 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:40.000330 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4a16f6d5-94f4-4d36-8107-5d21e5b7d54a tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1517 microversion: 2.1 time: 0.225208 May 10 17:27:40.001113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 502/1025] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:39 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:40.325237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:40.325880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:40.333201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:40.333670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:40.334492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:40.334948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:40.542228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:40.551862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:40.553413 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:40.554539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95d54038-48b6-4cba-b8e2-567cee33cfb3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.233137 May 10 17:27:40.555801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 524/1026] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:40 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:40.692036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:40.692652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:40.700063 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:40.700460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:40.701237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:40.701674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:40.889881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:40.898510 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7e031dd4-fbc7-4c3d-a47e-b4f51a200310 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.210271 May 10 17:27:40.899067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 503/1027] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:40 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:41.018325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:41.018899 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:41.026195 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.026688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:41.027479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.028565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:41.220543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:41.228992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-94040b53-b4df-4a61-9765-b0eda240dc04 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1519 microversion: 2.1 time: 0.214517 May 10 17:27:41.229570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 525/1028] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:41 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:41.573019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:41.573638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:41.581287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.581737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:41.582555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.582996 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:41.783726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:41.792386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:41.793921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:41.795036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b7993b65-0ab5-4f1c-9536-0b5555d3579e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.225965 May 10 17:27:41.795591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 504/1029] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:41 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:41.916003 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:41.916626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:41.924356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.924812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:41.925584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:41.926029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:42.126541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:42.135303 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-518aa181-72f1-4bec-9aa6-36f21a10b714 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.223171 May 10 17:27:42.135885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 526/1030] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:41 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:42.209216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-f75f2b79-b93b-4a08-a7e4-e0f82fbb444d req-e9b0433a-4d3f-480c-8482-511dec52808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "name": "network-vif-unplugged", "status": "completed", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:42.211143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:42.211143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:42.219962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f75f2b79-b93b-4a08-a7e4-e0f82fbb444d req-e9b0433a-4d3f-480c-8482-511dec52808e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:42.220524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f75f2b79-b93b-4a08-a7e4-e0f82fbb444d req-e9b0433a-4d3f-480c-8482-511dec52808e service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:42.238076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.compute.server_external_events [req-f75f2b79-b93b-4a08-a7e4-e0f82fbb444d req-e9b0433a-4d3f-480c-8482-511dec52808e service nova] Unable to find a host for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79. Dropping event network-vif-unplugged {{(pid=92809) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 10 17:27:42.239002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-f75f2b79-b93b-4a08-a7e4-e0f82fbb444d req-e9b0433a-4d3f-480c-8482-511dec52808e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033980 May 10 17:27:42.239602 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 505/1031] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:42 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 17:27:42.247475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:42.248253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:42.256934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:42.257392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:42.258179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:42.258654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:42.456668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:42.465998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-81df789d-9a83-4be7-9058-98af4f72bb3f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1519 microversion: 2.1 time: 0.222312 May 10 17:27:42.466592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 527/1032] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:42 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:42.817233 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:42.817860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:42.825694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:42.826143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:42.827015 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:42.827459 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:43.019393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:43.028066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:43.029582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:43.030691 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f45cafe9-ab53-409d-8f1e-d783fe8a6588 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.222362 May 10 17:27:43.031255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 506/1033] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:42 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:27:43.152606 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:43.153229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:43.160646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:43.161105 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:43.161879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:43.162321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:43.354016 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:43.363326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a89338c0-7dc4-4bf0-99e4-eb23e7104c92 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.214588 May 10 17:27:43.363886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 528/1034] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:43 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:43.484098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:43.484730 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:43.492278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:43.492737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:43.493534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:43.493980 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:43.766819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:43.775034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-927b80fc-cbea-4ec5-a338-fa26cb05b421 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1519 microversion: 2.1 time: 0.295277 May 10 17:27:43.775606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 507/1035] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:43 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1519 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:44.048295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:44.048954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:44.056455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.056921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.057744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.058194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.257937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-96e687af-c616-4206-976f-0ffa3505e603 req-004aa57c-93a7-4370-b94d-b4e23ddbe121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "name": "network-vif-plugged", "status": "completed", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:44.260281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:44.260281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:44.267443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:44.268990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-96e687af-c616-4206-976f-0ffa3505e603 req-004aa57c-93a7-4370-b94d-b4e23ddbe121 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.269439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-96e687af-c616-4206-976f-0ffa3505e603 req-004aa57c-93a7-4370-b94d-b4e23ddbe121 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.276299 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:44.278475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:44.279582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d47c579c-d223-4fc3-959d-91d8accac89d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.235106 May 10 17:27:44.280328 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 529/1036] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:44 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:44.296118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-96e687af-c616-4206-976f-0ffa3505e603 req-004aa57c-93a7-4370-b94d-b4e23ddbe121 service nova] Creating event network-vif-plugged:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:27:44.300802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-96e687af-c616-4206-976f-0ffa3505e603 req-004aa57c-93a7-4370-b94d-b4e23ddbe121 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047342 May 10 17:27:44.301562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 508/1037] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:27:44.380657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:44.381298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:44.389099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.389561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.390364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.390817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.587310 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:44.595994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0c79658a-e119-4e78-a210-7d1d82574e11 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.219008 May 10 17:27:44.596571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 530/1038] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:44 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:44.794012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:44.794665 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:44.802581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.803045 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:44.803836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:44.804282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:45.003474 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:45.011988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-73a3961f-541a-4e91-a063-874ba314806b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1519 microversion: 2.1 time: 0.222697 May 10 17:27:45.012571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 509/1039] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:44 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:45.297387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:45.298008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:45.305425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:45.305833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:45.306655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:45.307102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:45.499012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:45.507690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:45.509347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:45.510454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1f80d33c-bf94-460f-b133-6d9a88034aa3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1407 microversion: 2.20 time: 0.217585 May 10 17:27:45.511019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 531/1040] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:45 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:45.612805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:45.613426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:45.621327 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:45.621781 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:45.622588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:45.623030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:45.814195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:45.822895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dca9c155-a055-4f98-8de2-c7fed781cd56 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.213846 May 10 17:27:45.823466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 510/1041] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:45 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:46.032097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:46.032941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:46.042311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.042968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.043977 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.044541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.275890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:46.284768 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d43e48ec-f5a3-4d06-8ec4-4df8ab3cf798 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1519 microversion: 2.1 time: 0.259531 May 10 17:27:46.295294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 532/1042] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:46 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:46.528618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:46.529162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:46.536632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.537084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.537870 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.538310 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.736438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:46.745339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:46.747997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:46.748169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-099e23aa-fa21-4951-9a52-a24ea36a6914 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1599 microversion: 2.20 time: 0.223444 May 10 17:27:46.748648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 511/1043] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:27:46 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:27:46.765596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:46.766141 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:46.773956 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.774580 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.775526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.775978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.841029 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:46.841575 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:46.849057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.849515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.850306 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:46.850809 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:46.927613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-45ffaa56-7ccb-4554-819e-deadffd4d498 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165688 May 10 17:27:46.928677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 533/1044] 10.222.0.32 () {60 vars in 1316 bytes} [Mon May 10 17:27:46 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:27:47.078255 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:47.088120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f4ac0cc2-51c3-4da7-84d9-041e904baa60 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.251992 May 10 17:27:47.098927 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 512/1045] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:46 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:47.303660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:47.304282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:47.314058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:47.315100 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:47.316357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:47.317078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:47.519525 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:47.528385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dc69bfc6-ef8c-4dab-8417-d5e3c625dd60 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.228507 May 10 17:27:47.528957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 534/1046] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:47 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:47.545851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:47.546532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:47.553780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:47.554232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:47.555044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:47.555481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:47.799570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:47.809653 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a864902b-1ab1-4c31-be9b-8d45c8d8cfa2 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1595 microversion: 2.1 time: 0.266803 May 10 17:27:47.810324 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 513/1047] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:47 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1595 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:48.107638 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:48.108455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:48.115859 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:48.116325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:48.117116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:48.117565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:48.548586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:48.549234 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:48.557116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:48.557492 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:48.558509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:48.558954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:48.567529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:48.579449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c431c2e6-7bee-4baa-9023-7486e798015f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.475504 May 10 17:27:48.580847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 535/1048] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:48 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:48.982899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:48.999437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8ed4cec2-2146-497e-b0c9-8225c119e258 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.454413 May 10 17:27:49.000707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 514/1049] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:48 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:49.084047 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:49.090035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-a8fe28ad-d6d1-4cc1-be72-b5068bac8157 req-04383728-9fda-4ce4-98da-8482ca12afa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:49.092048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:49.092048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:49.093068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:49.107864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:49.108452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:49.109106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:49.109547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:49.121037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-a8fe28ad-d6d1-4cc1-be72-b5068bac8157 req-04383728-9fda-4ce4-98da-8482ca12afa3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:49.122018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-a8fe28ad-d6d1-4cc1-be72-b5068bac8157 req-04383728-9fda-4ce4-98da-8482ca12afa3 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:49.153658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-a8fe28ad-d6d1-4cc1-be72-b5068bac8157 req-04383728-9fda-4ce4-98da-8482ca12afa3 service nova] Creating event network-changed:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:27:49.162400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-a8fe28ad-d6d1-4cc1-be72-b5068bac8157 req-04383728-9fda-4ce4-98da-8482ca12afa3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075819 May 10 17:27:49.163384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 515/1050] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:49.263439 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bbcabec6-7e21-4df6-9ece-1e7d352ddf08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.183171 May 10 17:27:49.267172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 536/1051] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:49 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:49.599593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:49.600914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:49.611191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:49.612201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:49.613380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:49.614108 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:50.019485 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:50.021176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:50.040838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:50.042365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:50.044247 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:50.048421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:50.300584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:50.311201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a50e2792-34ac-440e-b1d2-e2737f69daf5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.717415 May 10 17:27:50.312119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 516/1052] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:49 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:50.323770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:50.325422 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:50.332858 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:50.333410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:50.334282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:50.334826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:50.454908 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-955c3072-c771-4f4e-8844-1c1bd16270ef tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.135243 May 10 17:27:50.458124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 517/1053] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:50 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:50.732762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:50.741203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c301d5ac-2e82-4c0f-a3b7-ab5e6b1a5951 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.727268 May 10 17:27:50.741785 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 537/1054] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:50 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:51.329121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:51.329748 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:51.337708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.338160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.338997 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.339436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.465441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:51.466556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:51.479685 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.480551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.482173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.483273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.629064 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-13769cea-45df-40d9-8fdb-880395daaf38 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.167317 May 10 17:27:51.630167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 538/1055] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:51 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:51.635527 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-9aa874f5-9eca-4e40-b545-57d6c67822ca req-35901b78-f43d-495a-82c4-1fdbc63c7fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:51.638139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:51.638139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:27:51.648104 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-9aa874f5-9eca-4e40-b545-57d6c67822ca req-35901b78-f43d-495a-82c4-1fdbc63c7fae service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.648816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-9aa874f5-9eca-4e40-b545-57d6c67822ca req-35901b78-f43d-495a-82c4-1fdbc63c7fae service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.667834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-9aa874f5-9eca-4e40-b545-57d6c67822ca req-35901b78-f43d-495a-82c4-1fdbc63c7fae service nova] Creating event network-changed:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:27:51.673700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-9aa874f5-9eca-4e40-b545-57d6c67822ca req-35901b78-f43d-495a-82c4-1fdbc63c7fae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041950 May 10 17:27:51.674994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 539/1056] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:51.719643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:51.729102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2cbb340e-dccd-4144-a57e-25e8794cd5d5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.404215 May 10 17:27:51.730269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 518/1057] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:51 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:51.763876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:51.765903 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:51.796409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.797674 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:51.799238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:51.800041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.208281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:52.219055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6e75cf3e-7e50-47df-894c-31b1e56cfd79 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.462470 May 10 17:27:52.220339 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 540/1058] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:51 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:52.640061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:52.641308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:52.656930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.657778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.658865 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.659326 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.749916 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:52.750592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:52.763530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.763998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.764894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.765484 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.827345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bc0de3c2-d2d1-42c9-8e29-69c5597d2131 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.190632 May 10 17:27:52.828595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 519/1059] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:52 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:52.866978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2041144508"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:52.867627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:52.892222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.893297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:52.894317 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:52.895137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.037362 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:53.048528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a8c52fe5-529e-4324-bcb1-95f1b44e5462 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.305235 May 10 17:27:53.052808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 541/1060] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:52 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:53.148106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.network.security_group_api [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Adding security group 52a9b31e-985a-4ccf-a0ae-08d8b9c5b3a1 to port 8d45ee84-4b67-4767-8c74-74969170668e May 10 17:27:53.236748 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:53.237764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:53.245873 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.246715 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.247738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.248399 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.619647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:53.628401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-63a1bbd5-c5b1-4d9a-8a2c-c271dae3c9a6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.395444 May 10 17:27:53.628984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 542/1061] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:53 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:53.838539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:53.841101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ab9cedc8-2dd9-4fb8-aaa2-07dabd2f4920 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action" status: 202 len: 0 microversion: 2.1 time: 0.978245 May 10 17:27:53.841702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 520/1062] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:27:52 2021] POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:27:53.849404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-fc7b636f-7d3e-4a7a-b17d-20eefa240db2 req-ae0078d8-fc68-45da-b951-fd527fd254d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:53.851014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:27:53.851014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:27:53.855066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:53.868669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.869204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.870051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.870535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.883076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fc7b636f-7d3e-4a7a-b17d-20eefa240db2 req-ae0078d8-fc68-45da-b951-fd527fd254d0 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.883534 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fc7b636f-7d3e-4a7a-b17d-20eefa240db2 req-ae0078d8-fc68-45da-b951-fd527fd254d0 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.901611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-fc7b636f-7d3e-4a7a-b17d-20eefa240db2 req-ae0078d8-fc68-45da-b951-fd527fd254d0 service nova] Creating event network-changed:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:27:53.906564 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-fc7b636f-7d3e-4a7a-b17d-20eefa240db2 req-ae0078d8-fc68-45da-b951-fd527fd254d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060535 May 10 17:27:53.907270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 521/1063] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:27:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:27:53.937033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:53.937871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:53.946619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.947328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:53.948318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:53.949660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:54.016576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-845d3c49-067d-466c-a401-0935072e4e97 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.181675 May 10 17:27:54.018045 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 543/1064] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:53 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:54.066647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:54.067394 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:54.083673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:54.084158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:54.085028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:54.085476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:54.524182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:54.533471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-680f3877-1a18-438a-a6aa-3bd0504bee97 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1760 microversion: 2.1 time: 0.620945 May 10 17:27:54.534111 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 522/1065] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:53 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1760 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:54.584985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:54.594621 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-156953eb-587e-41eb-8093-09b9771494f9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.532601 May 10 17:27:54.598490 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 544/1066] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:54 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:54.646555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:54.647314 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:54.655287 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:54.655826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:54.656625 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:54.657067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:55.028326 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:55.029535 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:55.033558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:55.037599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:55.038162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:55.039111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:55.039853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:55.045610 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-179ec6b7-7e92-4787-a08e-15238c93ac0d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.402331 May 10 17:27:55.052830 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 523/1067] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:54 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:55.160057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-24971369-17f8-427a-8b9e-9ce24443cf62 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.135372 May 10 17:27:55.160613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 545/1068] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:55 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:55.612487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:55.613114 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:55.620497 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:55.620959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:55.621800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:55.622246 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:55.813238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:55.821896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3120fdbc-2fe1-4801-b9e5-5460fe3bf9aa tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.213165 May 10 17:27:55.822491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 524/1069] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:55 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:56.063705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:56.064426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:56.072504 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.072968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:56.073757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.074743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:56.170958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:56.171940 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:56.179706 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.180167 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:56.180950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.181396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:56.274693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:56.283677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c2c42d49-f752-40f3-b405-3d5253a07b1f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.224154 May 10 17:27:56.284257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 546/1070] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:56 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:56.320742 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2100c150-5109-47b9-988a-9858aa35d8d7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.153370 May 10 17:27:56.321309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 525/1071] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:56 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:56.837958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:56.838719 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:56.846027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.846530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:56.847318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:56.847771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:57.037199 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:57.046687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-60b039b8-9c42-4650-b2d2-e394f940934a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.212454 May 10 17:27:57.047270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 547/1072] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:56 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:57.301904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:57.302648 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:57.310580 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:57.311039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:57.311819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:57.312264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:57.331785 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:57.332702 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:57.340862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:57.341316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:57.342089 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:57.342560 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:57.511381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:57.520001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-52db6b02-7ae8-435a-ae74-f68fb5dbc519 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.222250 May 10 17:27:57.520562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 526/1073] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:57 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:57.534822 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d6a1087a-06ab-4243-9beb-61e84b7b3114 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.206909 May 10 17:27:57.535493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 548/1074] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:57 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:58.064037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:58.064660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:58.072073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.072532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.073320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.073768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.267713 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:58.276338 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ce239e94-eb04-4fc2-985a-5d9472362ffc tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.216070 May 10 17:27:58.276903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 527/1075] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:58 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:58.537837 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:58.538518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:58.545778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:58.547215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.547388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:58.547687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.548491 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.548942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.555161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.555624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.556422 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:58.556867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:58.682416 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5dc2dd30-5f76-46f7-8fb6-b92529d73b6b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 14 microversion: 2.20 time: 0.140710 May 10 17:27:58.685591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 528/1076] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:58 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:27:58.983550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:58.991853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-20336a1d-f93a-46fa-9418-b921f474a0f8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.458335 May 10 17:27:58.992435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 549/1077] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:58 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:59.293776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:27:59.294436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:59.302457 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:59.302919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:59.303724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:59.304162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:59.502555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:27:59.511183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1d41fdbe-15d5-445c-956b-80b3f1dca2ec tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1724 microversion: 2.1 time: 0.221645 May 10 17:27:59.511832 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 529/1078] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:27:59 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:27:59.693288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:27:59.694237 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:27:59.702677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:59.703132 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:59.703915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:27:59.704354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:27:59.847943 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6b246f96-d96b-476b-8307-67ce4be1c96a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 6314 microversion: 2.20 time: 0.158157 May 10 17:27:59.848475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 550/1079] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:27:59 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 6314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:28:00.008761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:00.009662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:00.017437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.017890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.018689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.019130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.224465 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:00.233150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c683d0b1-4777-440d-b6d0-a5e1f93ccd0f tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.228137 May 10 17:28:00.233733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 530/1080] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:00 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:00.529121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:00.529753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:00.537547 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.538006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.538817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.539259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.729225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:00.738589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7456023e-84a6-48ab-bcd5-d4b78f4967ce tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1701 microversion: 2.1 time: 0.213619 May 10 17:28:00.739155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 551/1081] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:00 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1701 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:00.755197 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bebdd1cc-a44a-4c57-b4eb-fdece8496500 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:00.762993 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bebdd1cc-a44a-4c57-b4eb-fdece8496500 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.763451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-bebdd1cc-a44a-4c57-b4eb-fdece8496500 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.819403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-bebdd1cc-a44a-4c57-b4eb-fdece8496500 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Going to try to start instance {{(pid=92809) start /opt/stack/nova/nova/compute/api.py:2602}} May 10 17:28:00.859318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:00.860245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:00.867657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.868123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.868935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.869378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.902151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bebdd1cc-a44a-4c57-b4eb-fdece8496500 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.150152 May 10 17:28:00.906309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 531/1082] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:28:00 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:00.912658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:00.913370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:00.924088 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.924553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.925352 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:00.925797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:00.994542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c742d371-0a51-4fd3-82dd-19c2cf37ec54 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 15025 microversion: 2.20 time: 0.138509 May 10 17:28:00.996477 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 552/1083] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:00 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 15025 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:01.169937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:01.178631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2580ff49-0941-445a-b169-1b7af65af653 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1710 microversion: 2.1 time: 0.270624 May 10 17:28:01.179211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 532/1084] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:00 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1710 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:01.252147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:01.252871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:01.260881 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:01.261350 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:01.262141 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:01.262620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:01.634896 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:01.643395 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-07f4b6af-e539-484d-b404-42123337a275 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.395473 May 10 17:28:01.643976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 553/1085] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:01 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:02.006674 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:02.007585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:02.015288 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.015744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.016516 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.016955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.156129 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-321b73fe-20d2-4d24-95d2-a0179148927b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 18356 microversion: 2.20 time: 0.153025 May 10 17:28:02.158847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 533/1086] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:02 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 18356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:02.195919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:02.196545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:02.204267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.204722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.205497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.205944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.273514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-223cb700-b978-416c-a650-940df23e083b req-13e9ea84-b763-432d-9ec5-b65687359fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "name": "network-vif-plugged", "status": "completed", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:02.275215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:28:02.275215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:28:02.284836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-223cb700-b978-416c-a650-940df23e083b req-13e9ea84-b763-432d-9ec5-b65687359fd9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.285300 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-223cb700-b978-416c-a650-940df23e083b req-13e9ea84-b763-432d-9ec5-b65687359fd9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.301168 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-223cb700-b978-416c-a650-940df23e083b req-13e9ea84-b763-432d-9ec5-b65687359fd9 service nova] Creating event network-vif-plugged:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:28:02.305764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-223cb700-b978-416c-a650-940df23e083b req-13e9ea84-b763-432d-9ec5-b65687359fd9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036536 May 10 17:28:02.306558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 534/1087] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:28:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:28:02.405946 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:02.414890 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b8e6d1d7-ed00-407b-8473-454f7c24a559 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1710 microversion: 2.1 time: 0.222706 May 10 17:28:02.415456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 554/1088] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:02 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1710 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:02.661377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:02.662196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:02.670326 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.670812 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:02.671597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:02.672420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:03.001817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:03.010145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-644b70df-5cc8-454e-b835-5b3562867de8 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.352889 May 10 17:28:03.010742 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 535/1089] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:02 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:03.167575 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:03.169448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:03.176742 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:03.177203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:03.177994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:03.178483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:03.361714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-46a9e5d5-0a8f-47a6-bb9c-060c474ed39d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 19342 microversion: 2.20 time: 0.197736 May 10 17:28:03.362416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 555/1090] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:03 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 19342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:03.431822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:03.432443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:03.440371 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:03.440826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:03.441609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:03.442051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:03.636139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:03.645511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-006ebb3b-33d8-46fa-8053-8cea730ec33e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1714 microversion: 2.1 time: 0.217553 May 10 17:28:03.646094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 536/1091] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:03 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1714 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:04.027699 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:04.028409 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:04.036303 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:04.036763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:04.037528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:04.037977 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:04.232906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:04.241146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a1f1341c-890b-48ae-a584-044e7ed2ac00 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1575 microversion: 2.1 time: 0.217608 May 10 17:28:04.241719 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 556/1092] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:04 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:04.373730 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:04.374687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:04.382541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:04.383003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:04.383795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:04.384238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:04.557023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ef52af88-4873-4a76-8661-fa03e80cc7d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 22021 microversion: 2.20 time: 0.187383 May 10 17:28:04.557692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 537/1093] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:04 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 22021 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:05.258394 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:28:05.259021 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:05.266753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:05.267205 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:05.267979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:05.268418 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:05.460939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:28:05.469662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6d3e40ec-0412-4dcd-a735-1cf7e159d38d tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1562 microversion: 2.1 time: 0.214989 May 10 17:28:05.470233 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 557/1094] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:28:05 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:28:05.569791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:05.570885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:05.578749 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:05.579209 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:05.579990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:05.580437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:05.705315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-40982595-8dd0-41ad-8745-e00c98c2c326 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 23235 microversion: 2.20 time: 0.139589 May 10 17:28:05.706075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 538/1095] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:05 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 23235 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:06.716775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:06.717755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:06.725135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:06.725597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:06.726674 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:06.727125 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:06.865858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3397341e-b2fc-44d4-a0c4-8dfd6d0b9ac2 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 24892 microversion: 2.20 time: 0.152678 May 10 17:28:06.866554 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 558/1096] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:06 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 24892 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:07.878284 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:07.879384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:07.888124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:07.888578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:07.889357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:07.889802 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:08.046699 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-11200cf4-7ac9-4391-8901-d2b0d8e81b42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 26478 microversion: 2.20 time: 0.172421 May 10 17:28:08.047351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 539/1097] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:07 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 26478 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:09.059751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:09.060794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:09.068703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:09.069167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:09.069947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:09.070419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:09.204083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-82cc8226-1cd6-4966-816d-07bf4011c8ab tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 27451 microversion: 2.20 time: 0.149019 May 10 17:28:09.204757 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 559/1098] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:09 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 27451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:10.216547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:10.217541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:10.225695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:10.226186 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:10.227263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:10.227738 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:10.360054 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5f65b283-9031-44c5-b6a9-4d923d3be8ba tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 27797 microversion: 2.20 time: 0.147801 May 10 17:28:10.360689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 540/1099] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:10 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 27797 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:11.372839 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:11.373842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:11.381658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:11.382113 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:11.382909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:11.383348 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:11.517203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-15125d10-13c9-41f8-831b-85458355727e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28125 microversion: 2.20 time: 0.148862 May 10 17:28:11.517838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 560/1100] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:11 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28125 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:12.530099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:12.531173 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:12.539395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:12.539858 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:12.540642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:12.541093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:12.669718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6f4de9f2-05f2-4f65-a2de-e74934f4630f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.144316 May 10 17:28:12.670368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 541/1101] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:12 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:13.681908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:13.682953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:13.690802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:13.691265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:13.692066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:13.692513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:13.805823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b38f2192-476f-4216-87fd-6c8b88a34d7f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.127963 May 10 17:28:13.806478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 561/1102] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:13 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:14.818147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:14.819107 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:14.827138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:14.827599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:14.828382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:14.828828 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:14.952995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9587db08-d42d-4a73-b976-eb521bb8053a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.139010 May 10 17:28:14.953636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 542/1103] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:14 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:15.964976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:15.965992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:15.973834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:15.974419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:15.975102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:15.975546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:16.121358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5a6fb8a2-c8e4-4e01-9870-ce942e9aedc8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.159805 May 10 17:28:16.122010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 562/1104] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:15 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:17.133943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:17.134991 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:17.143382 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:17.143845 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:17.144629 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:17.145074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:17.264620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4bc90302-f4e7-4db4-b01b-9de63a4e29cb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.134729 May 10 17:28:17.265532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 543/1105] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:17 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:18.276814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:18.277804 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:18.285624 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:18.286079 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:18.286876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:18.287317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:18.412097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6361a022-4260-4087-9785-c3f05c6926ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.139402 May 10 17:28:18.412716 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 563/1106] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:18 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:19.424132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:19.425145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:19.433159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:19.433616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:19.434424 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:19.434872 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:19.573453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ad0d0577-1214-4564-81b5-ce8c7ffacd9a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.153502 May 10 17:28:19.574702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 544/1107] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:19 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:20.586854 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:20.587788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:20.596127 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:20.596587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:20.597410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:20.597855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:20.723989 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d4660005-3ff7-4e4d-91c5-24457bd29faa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.141429 May 10 17:28:20.724654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 564/1108] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:20 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:21.737044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:21.738057 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:21.746544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:21.747006 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:21.747784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:21.748231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:21.884122 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-02e618a7-f326-40f3-9ceb-d15e832b48b6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.151164 May 10 17:28:21.884746 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 545/1109] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:21 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:22.896651 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:22.897673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:22.905982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:22.906485 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:22.907278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:22.907908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:23.034370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f23a8032-bdf4-4d00-abba-cdf4f8cb757a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.141852 May 10 17:28:23.034953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 565/1110] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:22 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:24.047445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:24.048606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:24.056247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:24.056702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:24.057484 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:24.057921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:24.181767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a09bfb82-f3bb-4c95-a5d8-622293edb2c1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.138828 May 10 17:28:24.182623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 546/1111] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:24 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:25.194059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:25.195155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:25.202979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:25.203428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:25.204201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:25.204642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:25.331321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-85635c10-ae85-462b-bca8-c01584700675 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.141279 May 10 17:28:25.331861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 566/1112] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:25 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:26.343816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:26.344776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:26.352904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:26.353359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:26.354141 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:26.354618 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:26.489515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-765351ef-42ff-49b9-87a3-8f527b3f8afa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28226 microversion: 2.20 time: 0.149949 May 10 17:28:26.490154 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 547/1113] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:26 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:27.502619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:27.503576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:27.511483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:27.511937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:27.512714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:27.513164 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:27.652137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-48b8b0e6-1bfd-4a9d-9eec-1720e6479f3c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28517 microversion: 2.20 time: 0.154285 May 10 17:28:27.652791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 567/1114] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:27 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:28.664842 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:28.665875 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:28.674259 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:28.674748 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:28.675522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:28.675963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:28.819216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-69df7816-3719-4103-95d9-de7a8b599a08 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28622 microversion: 2.20 time: 0.158478 May 10 17:28:28.819855 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 548/1115] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:28 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:29.832119 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:29.833123 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:29.840963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:29.841418 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:29.842192 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:29.842663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:29.979838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3576c0b5-7fe1-489f-afa6-2f78fd4c1717 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.152348 May 10 17:28:29.980494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 568/1116] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:29 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:30.992824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:30.993825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:31.001679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:31.002131 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:31.002937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:31.003376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:31.128430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3236c613-a42c-4d99-bc18-eb09005bfdc0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.139700 May 10 17:28:31.129058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 549/1117] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:30 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:32.140795 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:32.141806 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:32.149673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:32.150137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:32.150944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:32.151392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:32.278437 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9162d403-5b64-4ded-9633-e3ec9b15bdee tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.142324 May 10 17:28:32.279008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 569/1118] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:32 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:33.290595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:33.291601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:33.299507 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:33.299907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:33.300679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:33.301121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:33.416767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cad69031-3ea7-460c-abfa-65ec72fb069c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.130208 May 10 17:28:33.417668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 550/1119] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:33 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:34.429019 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:34.430028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:34.438476 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:34.438945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:34.439725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:34.440171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:34.564533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0558a26a-ef3b-42a3-a34f-54a885be66aa tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.139575 May 10 17:28:34.565165 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 570/1120] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:34 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:35.577542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:35.578586 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:35.586620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:35.587078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:35.587867 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:35.588313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:35.711683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0f605cb8-4712-4618-9ab3-f1ad9ddbb351 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.138807 May 10 17:28:35.712309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 551/1121] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:35 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:36.724460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:36.725513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:36.734262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:36.734751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:36.735534 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:36.735980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:36.853141 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4926bc61-4bdd-422b-9f5c-5725e5b38a2f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.132821 May 10 17:28:36.853763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 571/1122] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:36 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:37.864931 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:37.865960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:37.874460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:37.874924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:37.875734 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:37.876180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:37.995898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8afcd41d-b1c1-4ec5-9773-3d293ba4808a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.134997 May 10 17:28:37.996545 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 552/1123] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:37 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:39.008318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:39.009327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:39.017319 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:39.017798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:39.018636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:39.019085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:39.141266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6d7489ec-c31a-4f46-81be-765a49f66b5c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.137012 May 10 17:28:39.141878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 572/1124] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:39 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:40.153589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:40.155183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:40.163093 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:40.163551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:40.164329 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:40.164773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:40.281920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2c107c1f-178b-4788-9caf-ac0276075487 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.132318 May 10 17:28:40.282530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 553/1125] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:40 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:41.293738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:41.294775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:41.303147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:41.303545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:41.304318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:41.304760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:41.433999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e09da266-4502-4d17-8a5d-4fe53cee023b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.144274 May 10 17:28:41.434602 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 573/1126] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:41 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:42.446645 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:42.447604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:42.456275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:42.456734 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:42.457500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:42.457944 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:42.581708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3eef2158-448a-49d6-a5e8-24848ea89179 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.139093 May 10 17:28:42.582262 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 554/1127] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:42 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:43.593951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:43.594982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:43.603059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:43.603516 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:43.604298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:43.604741 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:43.728017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-92e3cafe-d4f8-4b8f-89b4-9210c0bcc98c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.138309 May 10 17:28:43.728679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 574/1128] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:43 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:44.740301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:44.741410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:44.749685 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:44.750135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:44.750992 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:44.751439 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:44.870930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d510d98a-1a42-48e4-b34d-62ea8141c848 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.134723 May 10 17:28:44.871565 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 555/1129] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:44 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:45.883805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:45.884817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:45.893132 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:45.893569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:45.894428 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:45.894816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:46.016542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cfc19c37-d9a8-4860-b5d8-60d72defde51 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.136781 May 10 17:28:46.017434 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 575/1130] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:45 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:47.029137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:47.030146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:47.038119 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:47.038605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:47.039391 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:47.039829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:47.156394 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-11786361-1886-480a-a577-a6e714d4900c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.131289 May 10 17:28:47.157316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 556/1131] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:47 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:48.168709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:48.169708 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:48.178110 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:48.178599 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:48.179379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:48.179822 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:48.308059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d06eaa58-3d02-41c8-8330-0317e5b453bb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.143376 May 10 17:28:48.308622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 576/1132] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:48 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:49.321214 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:49.322160 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:49.330004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:49.330514 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:49.331291 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:49.331735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:49.448447 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-76978f52-0a83-4f1a-8ccc-de2a70697dde tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.131473 May 10 17:28:49.449069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 557/1133] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:49 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:50.460411 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:50.461426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:50.469638 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:50.470102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:50.471027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:50.471479 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:50.588882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1c8ec1de-0e5e-40dc-8280-6037de3d1701 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.132407 May 10 17:28:50.589450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 577/1134] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:50 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:51.600633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:51.601882 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:51.609728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:51.610178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:51.610986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:51.611428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:51.732796 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ebefaa31-191a-40e3-87b9-4fa9ca0622d6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.136246 May 10 17:28:51.733935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 558/1135] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:51 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:52.745711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:52.746759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:52.755271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:52.755734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:52.756517 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:52.756969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:52.874985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-be14dd08-058f-4803-b014-ab228652aa4c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.133267 May 10 17:28:52.875629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 578/1136] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:52 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:28:53.886949 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:53.887965 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:53.896404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:53.896861 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:53.897647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:53.898091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:54.065625 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f304bf1f-b0e3-495d-89b7-67aab8efac69 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.182613 May 10 17:28:54.066299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 559/1137] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:53 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:55.078676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:55.079711 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:55.087815 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:55.088278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:55.089057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:55.089502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:55.209002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-99c99d5c-bd71-4451-8f59-ac6c16af487e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.134921 May 10 17:28:55.209629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 579/1138] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:55 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:56.221950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:56.222912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:56.230978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:56.231430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:56.232200 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:56.232638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:56.357051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5b54e86e-ee42-43b8-b755-b650d4e3cfb9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.139788 May 10 17:28:56.357726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 560/1139] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:56 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:57.369391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:57.370474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:57.378834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:57.379347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:57.380175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:57.380654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:57.506743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b01a72b7-dfcb-49bb-9590-b2f6ca5bd69d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.141387 May 10 17:28:57.507379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 580/1140] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:57 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:58.519552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:58.520596 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:58.528388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:58.528854 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:58.529631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:58.530744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:58.660004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-baad0d1c-6753-4c08-b3f7-16798fe5bce4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.145128 May 10 17:28:58.660743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 561/1141] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:58 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:28:59.672586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:28:59.673610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:28:59.681469 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:59.681923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:59.682730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:28:59.683171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:28:59.817992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a3222595-6000-49f0-8e83-89dea33e32b7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.150049 May 10 17:28:59.818712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 581/1142] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:28:59 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:00.830104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:00.831136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:00.839028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:00.839486 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:00.840269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:00.840714 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:00.974432 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-60e7078c-8b38-4f0b-a4d1-05d24a9b9ee0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.148502 May 10 17:29:00.975059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 562/1143] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:00 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:01.986361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:01.987393 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:01.995483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:01.995947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:01.996730 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:01.997176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:02.119690 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4744890b-6d2c-4e60-b23e-3856e1cf73ad tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.137391 May 10 17:29:02.120320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 582/1144] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:01 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:03.132026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:03.133026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:03.141466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:03.141922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:03.142723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:03.143162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:03.262960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e4b7d478-f363-4f18-bd6e-647003e9fefb tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.134867 May 10 17:29:03.263600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 563/1145] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:03 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:04.275746 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:04.276687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:04.285107 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:04.285563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:04.286365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:04.286803 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:04.410913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-80d526af-696e-4764-84b0-95d4fbcc6ced tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.139252 May 10 17:29:04.411546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 583/1146] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:04 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:05.424010 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:05.425034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:05.433073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.433540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:05.434393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.434846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:05.563833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fffae19d-e89d-4d8b-9777-d2af9692af32 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.144635 May 10 17:29:05.564494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 564/1147] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:05 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:05.614332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:05.615384 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:05.623281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.623770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:05.624544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.624992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:05.763421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bfc12f4c-dd30-4182-9ca8-52006af155a1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action" status: 202 len: 0 microversion: 2.1 time: 0.152965 May 10 17:29:05.764172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 584/1148] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:29:05 2021] POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:05.772681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:05.773551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:05.782710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.783209 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:05.784012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:05.784536 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:06.111656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:06.120493 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7c28e49d-ce40-47ca-b3cc-182e83f274db tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1752 microversion: 2.1 time: 0.351956 May 10 17:29:06.121076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 565/1149] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:05 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1752 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:06.576140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:06.577882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:06.585427 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:06.585885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:06.586726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:06.587176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:06.713135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e75ed03a-aad7-49c3-accc-71ba1e3045ae tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.141054 May 10 17:29:06.713856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 585/1150] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:06 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:07.138171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:07.138819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:07.146900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:07.147359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:07.148138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:07.148585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:07.343397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:07.352333 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e864fb32-8a5c-4f95-8a4e-f71f4917ce5b tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.217640 May 10 17:29:07.352906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 566/1151] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:07 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:07.725572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:07.726607 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:07.734710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:07.735170 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:07.735944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:07.736387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:07.878051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a6b88578-110d-4129-8678-4b78db674abc tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 28685 microversion: 2.20 time: 0.156529 May 10 17:29:07.879084 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 586/1152] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:07 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 28685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:08.369982 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:08.370633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:08.378805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:08.379262 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:08.380044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:08.380487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:08.721846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:08.730846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-99fd8864-ac36-4ea4-a80d-b86744865400 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.364578 May 10 17:29:08.731415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 567/1153] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:08 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:08.890312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:08.891351 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:08.899617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:08.900090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:08.900884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:08.901336 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:09.044710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-26e60388-d3b5-488c-80e2-dcd90d00302a tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 30229 microversion: 2.20 time: 0.158383 May 10 17:29:09.045509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 587/1154] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:08 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 30229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:09.747890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:09.748525 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:09.756168 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:09.756623 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:09.757400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:09.757841 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:09.954250 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:09.963008 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5571b954-1d09-490b-b481-6700ff95c661 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.218844 May 10 17:29:09.963563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 568/1155] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:09 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:10.056855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:10.057867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:10.065771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:10.066235 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:10.067048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:10.067498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:10.216958 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9bb390d9-fc0b-466e-b0b7-631c6423046b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 31996 microversion: 2.20 time: 0.164177 May 10 17:29:10.217610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 588/1156] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:10 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 31996 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:10.980600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:10.981227 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:10.989201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:10.989662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:10.990566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:10.991015 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:11.071851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:11.072465 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:11.080347 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:11.080818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:11.081606 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:11.082053 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:11.197782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:11.207228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a9f1a229-e76c-4557-b0b0-979d4e4ff68f tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.230630 May 10 17:29:11.208008 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 569/1157] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:10 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:11.228984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:11.229953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:11.237468 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:11.237925 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:11.238834 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:11.239276 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:11.245370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lazy-loading 'services' on Instance uuid 48120777-14d3-4deb-9f45-1146dc41c5c6 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:29:11.370239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e4be18a8-deac-43cf-beba-9bbc42138cd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 33276 microversion: 2.20 time: 0.144864 May 10 17:29:11.371086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 570/1158] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:11 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 33276 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:11.380318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a84947d3-74c0-48c0-a064-8a566f041230 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-volume_attachments/3d51a88b-a8fc-4c4f-9193-1c6b1c66f976" status: 202 len: 0 microversion: 2.1 time: 0.312442 May 10 17:29:11.381035 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 589/1159] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:29:11 2021] DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/os-volume_attachments/3d51a88b-a8fc-4c4f-9193-1c6b1c66f976 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:12.224251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:12.225061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:12.233305 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:12.233759 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:12.234579 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:12.235016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:12.384401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:12.385570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:12.393939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:12.394454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:12.395249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:12.395700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:12.441487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:12.450157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-674a0d4e-2d07-45f0-a70a-7f6390c67c9a tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.230071 May 10 17:29:12.450764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 571/1160] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:12 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:12.534058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7189e19c-0c62-4b72-988b-6adfbb77fd18 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 33977 microversion: 2.20 time: 0.154096 May 10 17:29:12.534860 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 590/1161] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:12 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 33977 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:13.466871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:13.467544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:13.475150 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.475603 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.476377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.477069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.546941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:13.548102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:13.556255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.556789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.557650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.558171 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.680448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:13.690599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2ea048e5-e326-4a8c-8124-bb1eed62f895 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.227442 May 10 17:29:13.691178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 572/1162] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:13 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:13.692241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aa61957e-5792-4c22-a944-f8f67e4b991f tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 35170 microversion: 2.20 time: 0.149865 May 10 17:29:13.692904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 591/1163] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:13 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 35170 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:13.695877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f2badb8a-6e46-4b6b-802f-21dedf77d37e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:13.703839 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f2badb8a-6e46-4b6b-802f-21dedf77d37e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.704302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f2badb8a-6e46-4b6b-802f-21dedf77d37e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.766094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f2badb8a-6e46-4b6b-802f-21dedf77d37e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Going to try to stop instance {{(pid=92809) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 10 17:29:13.841725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f2badb8a-6e46-4b6b-802f-21dedf77d37e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.149313 May 10 17:29:13.842951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 573/1164] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:29:13 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:13.851505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:13.852975 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:13.860536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.861005 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:13.861808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:13.862260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:14.059318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:14.067762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-27ca4923-fa06-4879-b744-43959647262c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.220340 May 10 17:29:14.068334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 592/1165] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:13 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:29:14.705083 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:14.706095 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:14.707626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:14.708252 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:14.713676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:14.714134 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:14.714950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:14.715398 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:14.715521 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:14.715932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:14.716718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:14.717215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:14.859274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-60ad1448-2872-4061-a582-78a263c3e3b0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 36492 microversion: 2.20 time: 0.158814 May 10 17:29:14.863358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 574/1166] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:14 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 36492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:14.917222 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:14.926099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9ae7dfe1-5817-4deb-ada5-b430b9b89dc7 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.222211 May 10 17:29:14.926698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 593/1167] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:14 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:29:15.085285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:15.086002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:15.094577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.095039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:15.095821 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.096269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:15.290757 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:15.298970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-864b4cf6-220e-4198-93e5-e7df491e9608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.217841 May 10 17:29:15.299479 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 575/1168] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:15 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:15.871037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:15.872017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:15.879984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.880446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:15.881231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.881706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:15.943785 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:15.944409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:15.951617 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.952072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:15.952843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:15.953282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:16.007726 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-11bbe07b-ef43-45bc-be34-0faa627e4a77 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 37991 microversion: 2.20 time: 0.140230 May 10 17:29:16.008935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 594/1169] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:15 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 37991 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:16.150403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:16.159729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-364dc6bd-7380-441a-ae57-83c730c55cba tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.220470 May 10 17:29:16.160301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 576/1170] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:15 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:29:16.317742 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:16.318489 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:16.326351 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:16.327536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:16.328329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:16.328780 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:16.527670 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:16.535969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ee4d2fad-44c7-46a1-86f0-86a959d1dc75 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.222489 May 10 17:29:16.536539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 595/1171] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:16 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:17.018925 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:17.019848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:17.027273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.027740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.028521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.028964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.161169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-af1d8019-8ac5-46c8-bf61-ca75f80a3ee5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 38241 microversion: 2.20 time: 0.145838 May 10 17:29:17.161813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 577/1172] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:17 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 38241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:17.176932 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:17.177557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:17.184930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.185383 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.186156 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.186627 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.385653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:17.394912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d86ab894-5c1b-4e85-8403-1e88468e4783 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1757 microversion: 2.1 time: 0.221639 May 10 17:29:17.395488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 596/1173] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:17 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:17.553461 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:17.554205 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:17.562039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.562551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.563334 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:17.563776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:17.850727 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:17.859279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-36921736-b24e-4f48-a9f7-d304d18e37c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.310007 May 10 17:29:17.859905 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 578/1174] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:17 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:18.173823 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:18.174769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:18.182080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.182653 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:18.183333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.183776 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:18.307271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2c13fed7-e8b5-4510-a4c1-2137749aed5b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 38241 microversion: 2.20 time: 0.137641 May 10 17:29:18.307852 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 597/1175] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:18 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 38241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 10 17:29:18.411519 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:18.412143 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:18.419501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.419958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:18.421302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.421742 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:18.621121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:18.629788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-553250c1-5f4d-48e6-8b07-d181f478535c tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1760 microversion: 2.1 time: 0.222018 May 10 17:29:18.630378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 579/1176] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:18 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:18.877342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:18.878059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:18.885951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.886509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:18.887290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:18.887734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:19.078802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:19.086982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-df879e73-20c5-4608-a5d1-5b59f69748e9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.214473 May 10 17:29:19.087555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 598/1177] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:18 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:19.320415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:19.321261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:19.329282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:19.329737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:19.330552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:19.330993 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:19.448031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3b5b8c86-5bf6-4270-8654-5d2023561ff0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 38241 microversion: 2.20 time: 0.131659 May 10 17:29:19.448677 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 580/1178] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:19 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 38241 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:20.104545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:20.105231 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:20.113063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.113542 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.114327 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.114802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.317539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:20.325723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1726e8d4-d6f1-4038-981e-a221375670f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.225250 May 10 17:29:20.326295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 599/1179] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:20 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:20.460998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:20.462000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:20.469761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.470217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.471026 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.471466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.605773 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-80b592a8-ea4b-445c-a3a2-7adcf49fcd09 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 200 len: 38384 microversion: 2.20 time: 0.148804 May 10 17:29:20.606472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 581/1180] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:20 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 38384 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:20.616787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:20.617307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:20.624607 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.625090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.625865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:20.626310 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:20.685510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6aeeadd6-33c3-45e7-9965-c63aa25a074b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/ips" status: 200 len: 152 microversion: 2.20 time: 0.072426 May 10 17:29:20.686088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 600/1181] 10.222.0.32 () {60 vars in 1289 bytes} [Mon May 10 17:29:20 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:29:21.344137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:21.344762 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:21.352960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:21.353409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:21.354190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:21.354657 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:21.553543 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:21.562222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-87e7565a-1c43-4eed-8da6-2a5938dd858f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.223202 May 10 17:29:21.562814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 582/1182] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:21 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:22.579000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:22.579625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:22.587403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:22.587864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:22.588645 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:22.589092 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:22.781236 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:22.789505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9d47c937-dcaf-4cfc-af07-d6c744ac1593 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.214249 May 10 17:29:22.790063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 601/1183] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:22 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:22.926631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:22.927168 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:22.934869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:22.935330 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:22.936103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:22.936541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:22.992078 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lazy-loading 'flavor' on Instance uuid b181282d-1624-4f3e-a6c7-5fb448435bcd {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:29:23.310778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cedd3960-ff5c-4602-93ad-3b2533e0f700 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 202 len: 0 microversion: 2.20 time: 0.387776 May 10 17:29:23.311594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 583/1184] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:22 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:29:23.319505 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:23.320125 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:23.327897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:23.328353 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:23.329129 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:23.329569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:23.525166 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:23.534466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:23.536012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:23.537146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cb1c6c93-3481-4e90-81e8-0f943e3497a6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.221371 May 10 17:29:23.537700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 602/1185] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:23 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:23.807709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:23.808345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:23.816449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:23.816901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:23.817670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:23.818103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:24.017779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:24.026099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f5f91214-8ffb-415c-b791-07e463772843 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1678 microversion: 2.1 time: 0.222666 May 10 17:29:24.026690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 584/1186] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:23 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:24.554722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:24.555325 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:24.562685 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:24.563151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:24.563942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:24.564388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:24.757988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:24.767497 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:24.769041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:24.770189 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-17e17bc5-6f70-434c-a601-0ff3b28a367d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.219287 May 10 17:29:24.770789 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 603/1187] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:24 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:25.043673 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:25.044293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:25.052077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.052531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.053300 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.053733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.247581 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:25.256466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5b4b8140-5088-4c86-8584-1e83bca6906f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1655 microversion: 2.1 time: 0.216469 May 10 17:29:25.257038 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 585/1188] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:25 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1655 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:25.273135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b8eef2b2-7870-49e7-a22f-a05fb43e5ce8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:25.280467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8eef2b2-7870-49e7-a22f-a05fb43e5ce8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.280924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b8eef2b2-7870-49e7-a22f-a05fb43e5ce8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.335954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b8eef2b2-7870-49e7-a22f-a05fb43e5ce8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Going to try to start instance {{(pid=92810) start /opt/stack/nova/nova/compute/api.py:2602}} May 10 17:29:25.409833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b8eef2b2-7870-49e7-a22f-a05fb43e5ce8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action" status: 202 len: 0 microversion: 2.1 time: 0.140325 May 10 17:29:25.410662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 604/1189] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:29:25 2021] POST /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:25.419913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:25.420539 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:25.428199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.428725 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.430239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.430811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.672081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:25.680161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4c4bd53b-3b62-4c18-a5b7-683d690c2b24 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1664 microversion: 2.1 time: 0.264427 May 10 17:29:25.680724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 586/1190] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:25 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1664 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:25.789743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:25.790488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:25.798224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.798769 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:25.799545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:25.799991 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:26.138681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:26.148027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:26.149723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:26.151073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-580c9bbe-006c-4eb8-8fa2-bd2688237143 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.365561 May 10 17:29:26.151683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 605/1191] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:25 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:26.697836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:26.698408 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:26.705505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:26.705958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:26.706768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:26.707208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:26.898373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:26.907002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-442d5aa4-0ee7-484c-8fd0-3109899420a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1664 microversion: 2.1 time: 0.213040 May 10 17:29:26.907561 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 587/1192] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:26 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1664 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:27.168759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:27.169381 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:27.177110 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:27.177571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:27.178379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:27.178834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:27.377313 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:27.385980 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:27.387586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:27.388719 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95c70ea8-53f5-485f-a321-542f00c68541 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.223735 May 10 17:29:27.389908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 606/1193] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:27 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:27.924273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:27.924891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:27.932258 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:27.932598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:27.933376 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:27.933816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:28.127000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:28.135118 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-79da35c5-af76-4169-836f-bd2b77ce0d00 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1668 microversion: 2.1 time: 0.215044 May 10 17:29:28.135681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 588/1194] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:27 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:28.407571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:28.408187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:28.415410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:28.415868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:28.416641 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:28.417082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:28.619663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:28.628297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:28.629865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:28.631173 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4d3d80ed-210e-49b7-a1d2-b53327510311 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.227948 May 10 17:29:28.631731 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 607/1195] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:28 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:29.649280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:29.649899 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:29.658037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:29.658526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:29.659299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:29.659737 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:29.847495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:29.856517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:29.858668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:29.859814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-35cce467-6bc0-439d-ada1-6b3024d181a9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.214372 May 10 17:29:29.860378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 589/1196] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:29 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:30.877610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:30.878277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:30.885546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:30.885999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:30.886809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:30.887251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:31.083576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:31.092229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:31.093763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:31.094965 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5363fc00-3ac1-4c5c-b517-b452b7e07186 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.221126 May 10 17:29:31.095567 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 608/1197] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:30 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:32.113521 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:32.114145 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:32.121493 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:32.121962 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:32.122771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:32.123218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:32.316708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:32.325272 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:32.326808 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:32.327932 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1c85b583-65a9-4964-8d9a-0512a8ad7c15 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.218286 May 10 17:29:32.328511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 590/1198] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:32 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:33.345076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:33.345643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:33.353153 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:33.353626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:33.354406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:33.354850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:33.556518 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:33.565753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:33.567405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:33.568570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e116ef6d-ffe1-4cf7-a80e-2c57ae3cdce8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.227448 May 10 17:29:33.569187 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 609/1199] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:33 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:34.586124 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:34.586765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:34.594666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:34.595122 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:34.595889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:34.596326 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:34.792856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:34.801577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:34.803174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:34.804298 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a014e9cb-24f2-4c51-a998-db2460589652 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.222027 May 10 17:29:34.804846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 591/1200] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:34 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:29:35.821854 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:35.822507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:35.830363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:35.830825 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:35.831615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:35.832063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:36.025861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:36.035735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:36.037360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:36.038724 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0d02185a-755e-4456-b739-fd0b62262d63 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1745 microversion: 2.20 time: 0.220654 May 10 17:29:36.039493 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 610/1201] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:35 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:37.057794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:37.058432 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:37.065632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:37.066088 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:37.066909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:37.067353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:37.260183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:37.268761 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:37.270262 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:37.271412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3fe8798b-8685-484c-93a3-6d55960af2cd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1745 microversion: 2.20 time: 0.217261 May 10 17:29:37.271970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 592/1202] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:37 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1745 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:38.289605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:38.290229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:38.297909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:38.298390 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:38.299175 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:38.299622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:38.548405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:38.557183 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:38.558743 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:38.559877 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ba1071a1-46e7-4fb5-b589-d35773485da6 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1745 microversion: 2.20 time: 0.274147 May 10 17:29:38.560441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 611/1203] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:38 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1745 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:38.813301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-9f874669-cbbc-472c-9e3b-9308c9eba289 req-3bc2c8af-735e-4acf-a05b-bc2601ea2808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "name": "network-vif-plugged", "status": "completed", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:38.815071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:29:38.815071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:29:38.825074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-9f874669-cbbc-472c-9e3b-9308c9eba289 req-3bc2c8af-735e-4acf-a05b-bc2601ea2808 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:38.825530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-9f874669-cbbc-472c-9e3b-9308c9eba289 req-3bc2c8af-735e-4acf-a05b-bc2601ea2808 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:38.846230 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-9f874669-cbbc-472c-9e3b-9308c9eba289 req-3bc2c8af-735e-4acf-a05b-bc2601ea2808 service nova] Creating event network-vif-plugged:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:29:38.851068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-9f874669-cbbc-472c-9e3b-9308c9eba289 req-3bc2c8af-735e-4acf-a05b-bc2601ea2808 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041581 May 10 17:29:38.851662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 593/1204] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:29:39.578106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:39.579390 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:39.587282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:39.587733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:39.588544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:39.588985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:39.866495 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:39.875174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:39.877280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:39.878458 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e39e7f75-7d9d-4c46-b2ba-d172f7249607 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1745 microversion: 2.20 time: 0.304074 May 10 17:29:39.879017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 612/1205] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:39 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:40.013847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:29:40.014361 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:29:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:29:40.897414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:40.898121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:40.905597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:40.906064 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:40.906850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:40.907286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:41.150147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:41.158994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:41.160518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:41.161672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-27e84bc3-d64b-40fe-b421-b03e694dff72 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1745 microversion: 2.20 time: 0.268491 May 10 17:29:41.162712 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 594/1206] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:40 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1745 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:42.179584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:42.180323 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:42.188102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:42.188573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:42.189385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:42.189833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:42.416962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:42.427007 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:42.428549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:42.429695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2a60e02f-8100-4185-8300-efd8b3290025 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.253957 May 10 17:29:42.430255 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 613/1207] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:42 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:43.449128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:43.450018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:43.461644 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:43.462110 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:43.462960 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:43.463659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:43.673436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:43.687491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:43.689950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:43.691570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b855bc34-cabe-4c97-b0af-b87f2235c808 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.246603 May 10 17:29:43.692426 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 595/1208] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:43 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:44.709223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:44.710111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:44.717316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:44.718028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:44.719612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:44.720131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:44.946779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:44.957908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:44.959474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:44.960766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cc41d37c-edba-4b9e-b96e-802d145a1c42 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.255446 May 10 17:29:44.974371 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 614/1209] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:44 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:29:45.981806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:45.982852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:46.003995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:46.005611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:46.007338 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:46.008106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:46.240846 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:46.250819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:46.252652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:46.253908 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-271aaec0-6e5e-4c98-bb80-bbac8bfb7a12 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.275981 May 10 17:29:46.254982 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 596/1210] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:45 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:46.777605 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:46.778774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:46.791314 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-66365cc4-7ffd-4815-8a6c-9d7316cc9684 req-a5eb05d0-c4df-4ea1-b59b-32cc9740126d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:46.792002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:46.793809 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:29:46.793809 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:29:46.794446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:46.795651 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:46.796281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:46.804779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-66365cc4-7ffd-4815-8a6c-9d7316cc9684 req-a5eb05d0-c4df-4ea1-b59b-32cc9740126d service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:46.805557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-66365cc4-7ffd-4815-8a6c-9d7316cc9684 req-a5eb05d0-c4df-4ea1-b59b-32cc9740126d service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:46.823977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-66365cc4-7ffd-4815-8a6c-9d7316cc9684 req-a5eb05d0-c4df-4ea1-b59b-32cc9740126d service nova] Creating event network-changed:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:29:46.831004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-66365cc4-7ffd-4815-8a6c-9d7316cc9684 req-a5eb05d0-c4df-4ea1-b59b-32cc9740126d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043336 May 10 17:29:46.834621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 597/1211] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:29:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:29:46.876572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:29:47.058463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-db3a111d-905a-43dd-ad33-b3a55101e378 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "DELETE /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 204 len: 0 microversion: 2.1 time: 0.284813 May 10 17:29:47.059146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 615/1212] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:29:46 2021] DELETE /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:29:47.068513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:47.070297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:47.097188 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:47.098039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:47.103003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:47.103690 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:47.274322 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:47.275276 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:47.283290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:47.283887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:47.284909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:47.285461 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:47.574332 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:47.587409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-31bac865-41a4-4cd8-899d-a3dde23619b4 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1568 microversion: 2.1 time: 0.523267 May 10 17:29:47.598780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 598/1213] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:47 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1568 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:47.730280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:47.750452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:47.754265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:47.756295 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b20f7fdd-6082-44c3-b582-1186e51078da tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.486730 May 10 17:29:47.766960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 616/1214] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:47 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:48.605245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:48.606538 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:48.614852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:48.615671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:48.616782 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:48.617609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:48.776078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:48.776810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:48.784695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:48.785184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:48.786027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:48.786526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:48.851752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:48.862063 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-00513608-29cd-4092-b226-d75871c5fe7b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1449 microversion: 2.1 time: 0.260959 May 10 17:29:48.862965 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 599/1215] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:48 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1449 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:49.016844 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:49.027934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:49.030895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:49.033612 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0b347722-a748-48a5-af67-08bc1fb16a41 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.261532 May 10 17:29:49.047513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 617/1216] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:48 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:49.884331 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:49.885018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:49.893994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:49.895088 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:49.896013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:49.896572 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:50.057311 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:50.058006 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:50.067920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:50.068385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:50.069174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:50.069618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:50.189183 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:50.217809 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-faf7da90-b340-4ff3-b105-05acb641d77b tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1381 microversion: 2.1 time: 0.341904 May 10 17:29:50.220100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 600/1217] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:49 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1381 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:50.261495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-f6978fd5-5f5a-44b8-bcc5-f85dd828d61f req-bdcf127c-efef-4c07-8277-e61732645e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261e9b77-db9a-4a51-bd06-480d1bff4a79", "name": "network-vif-deleted", "tag": "df51801e-4b4f-4882-bfda-80d9c2c3b7fc"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:50.263061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:29:50.263061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:29:50.280379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f6978fd5-5f5a-44b8-bcc5-f85dd828d61f req-bdcf127c-efef-4c07-8277-e61732645e0f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:50.280922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-f6978fd5-5f5a-44b8-bcc5-f85dd828d61f req-bdcf127c-efef-4c07-8277-e61732645e0f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:50.302874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-f6978fd5-5f5a-44b8-bcc5-f85dd828d61f req-bdcf127c-efef-4c07-8277-e61732645e0f service nova] Creating event network-vif-deleted:df51801e-4b4f-4882-bfda-80d9c2c3b7fc for instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 on hv-cinder-78638 May 10 17:29:50.309161 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-f6978fd5-5f5a-44b8-bcc5-f85dd828d61f req-bdcf127c-efef-4c07-8277-e61732645e0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053878 May 10 17:29:50.310275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 601/1218] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:29:50.468976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:50.479779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:50.481488 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:50.486640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c78a557f-8db9-4fc2-8d47-60adb8f218f0 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.429597 May 10 17:29:50.487955 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 618/1219] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:50 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:51.206609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:29:51.207251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:29:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:29:51.238436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:51.239225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:51.247558 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:51.248147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:51.248979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:51.249423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:51.337389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:51.337929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:51.338722 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lazy-loading 'fault' on Instance uuid 261e9b77-db9a-4a51-bd06-480d1bff4a79 {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:29:51.431079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e59d19771484ad188993b1bcccba538', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f31dcd80b43441793b8dccf23bea16a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:51.439509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f74aadd3-5ab8-4840-bce9-a44353aefdfb tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 200 len: 1223 microversion: 2.1 time: 0.206579 May 10 17:29:51.440302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 602/1220] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:51 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 1223 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:29:51.506263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:51.508705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:51.520069 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:51.521220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:51.522642 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:51.523267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:51.771415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:51.780271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:51.782467 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:51.783868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-508f793e-5532-40a1-af23-fd1e1e21aebd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.281470 May 10 17:29:51.784643 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 619/1221] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:51 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:52.457289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:52.457947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] [instance: 261e9b77-db9a-4a51-bd06-480d1bff4a79] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:52.465282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:52.465744 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:52.466562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:52.467014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:52.516860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] HTTP exception thrown: Instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 could not be found. May 10 17:29:52.517403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Returning 404 to user: Instance 261e9b77-db9a-4a51-bd06-480d1bff4a79 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:29:52.518242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7f70b9f7-03ad-44eb-8e73-3f7c486ecac6 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79" status: 404 len: 111 microversion: 2.1 time: 0.064859 May 10 17:29:52.518817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 603/1222] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:29:52 2021] GET /compute/v2.1/servers/261e9b77-db9a-4a51-bd06-480d1bff4a79 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:29:52.718613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cbfe6edf-67c9-4e33-8dd8-6b4e97561382 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] Calling method '.version_select at 0x7f41446c5af0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:52.738387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cbfe6edf-67c9-4e33-8dd8-6b4e97561382 tempest-TestShelveInstance-2017996900 tempest-TestShelveInstance-2017996900-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-547954858" status: 202 len: 0 microversion: 2.1 time: 0.023432 May 10 17:29:52.739002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 620/1223] 10.222.0.32 () {58 vars in 1251 bytes} [Mon May 10 17:29:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-547954858 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:29:52.892097 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:52.892798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:52.901040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:52.901743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:52.902665 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:52.903283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:53.111664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:53.120484 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:53.122077 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:53.123267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-065c7422-d007-47e9-bb09-0aeab3280f9d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1740 microversion: 2.20 time: 0.323624 May 10 17:29:53.124045 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 604/1224] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:52 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:29:54.140865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:54.141603 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:54.149694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:54.150250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:54.151169 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:54.151610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:54.351126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:54.361543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:54.363132 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:54.364369 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e8446601-49a6-4301-9e80-ac54265c26f9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1722 microversion: 2.20 time: 0.227252 May 10 17:29:54.364978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 621/1225] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:54 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:55.382598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:55.383222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:55.391626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:55.392090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:55.393368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:55.393368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:55.599817 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:55.610007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:55.611649 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:55.612805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4da69381-6e2c-4ac5-97ad-0890e28b7b84 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1722 microversion: 2.20 time: 0.234179 May 10 17:29:55.613363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 605/1226] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:55 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:56.636733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:56.642215 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:56.656877 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:56.657635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:56.658684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:56.659131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:56.878552 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:56.889086 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:56.891632 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:56.893349 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3cc7c977-70a8-419e-b190-a104737b741c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1722 microversion: 2.20 time: 0.264521 May 10 17:29:56.894080 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 622/1227] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:56 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:56.973012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-1be60aa5-3aed-4d3e-8498-b9a80581ecdf req-a9b41185-ec89-4fc4-a737-938c6aee6c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:56.975105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:29:56.975105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:29:56.986283 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-1be60aa5-3aed-4d3e-8498-b9a80581ecdf req-a9b41185-ec89-4fc4-a737-938c6aee6c44 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:56.987116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-1be60aa5-3aed-4d3e-8498-b9a80581ecdf req-a9b41185-ec89-4fc4-a737-938c6aee6c44 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:57.004774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-1be60aa5-3aed-4d3e-8498-b9a80581ecdf req-a9b41185-ec89-4fc4-a737-938c6aee6c44 service nova] Creating event network-vif-unplugged:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:29:57.010002 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-1be60aa5-3aed-4d3e-8498-b9a80581ecdf req-a9b41185-ec89-4fc4-a737-938c6aee6c44 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042613 May 10 17:29:57.011320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 606/1228] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:29:56 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:29:57.912985 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:57.913616 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:57.921244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:57.921704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:57.922528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:57.922978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:58.185415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:58.195194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:58.196992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:58.198354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-946b33de-d859-4dca-b8ed-3802d95edb75 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1665 microversion: 2.20 time: 0.289628 May 10 17:29:58.199012 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 623/1229] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:57 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1665 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:29:58.217279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "735a5db0-ecc8-4563-bb49-491a4d2c4e58"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:58.218472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:58.226244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:58.227001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:58.228455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:58.228898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:58.696814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c19946b5-3eb8-4908-89ac-f64119e4b473 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.483566 May 10 17:29:58.697743 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 607/1230] 10.222.0.32 () {62 vars in 1364 bytes} [Mon May 10 17:29:58 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-volume_attachments => generated 188 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:29:58.807382 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:58.807887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:58.815817 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:58.816245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:58.817043 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:58.818254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:59.223636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-16c5c8f2-65b5-45c6-b3da-e6809d73c8d3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-volume_attachments/735a5db0-ecc8-4563-bb49-491a4d2c4e58" status: 202 len: 0 microversion: 2.20 time: 0.420546 May 10 17:29:59.224386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 624/1231] 10.222.0.32 () {60 vars in 1457 bytes} [Mon May 10 17:29:58 2021] DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/os-volume_attachments/735a5db0-ecc8-4563-bb49-491a4d2c4e58 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:29:59.320816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:29:59.321497 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:59.329257 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:59.329718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:59.330528 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:59.330971 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:59.475195 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-135b5987-5749-4760-be5f-11719c634e9b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action" status: 202 len: 0 microversion: 2.20 time: 0.158154 May 10 17:29:59.479013 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 608/1232] 10.222.0.32 () {62 vars in 1319 bytes} [Mon May 10 17:29:59 2021] POST /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:29:59.484057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:29:59.485088 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:29:59.494894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:59.495760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:59.496714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:29:59.498288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:29:59.711083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:59.719885 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:59.721725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:29:59.722924 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1d8d31cf-7aa9-4190-b44c-5aa263ccbcfd tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1673 microversion: 2.20 time: 0.242712 May 10 17:29:59.723486 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 625/1233] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:29:59 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:00.740951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:00.741574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:00.749192 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:00.749708 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:00.750477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:00.750954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:00.950359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:00.959148 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:00.960676 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:00.961815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-52a93f6f-abe0-4882-9b2a-af0763c402d9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.224696 May 10 17:30:00.962390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 609/1234] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:00 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:01.980435 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:01.981781 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:01.992057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:01.992882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:01.993904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:01.994597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:02.546925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:02.556894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:02.558496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:02.559669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0fd6e7c2-2c68-462b-ae40-c7328637a97c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.583255 May 10 17:30:02.560457 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 626/1235] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:01 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:03.581061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:03.581061 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:03.587681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:03.588144 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:03.588943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:03.589390 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:03.961935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:03.972277 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:03.973947 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:03.975125 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3acffc18-5d95-4800-b7fd-2074b1237eaf tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.401729 May 10 17:30:03.975688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 610/1236] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:03 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:04.995264 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:04.996094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:05.006207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:05.007345 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:05.008681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:05.009431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:05.216750 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:05.236121 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:05.238312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:05.240082 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-63727127-7be1-45fa-9582-1d18618e9ca8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.249232 May 10 17:30:05.251906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 627/1237] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:04 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:30:06.259008 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:06.259620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:06.267914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:06.268363 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:06.269152 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:06.269642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:06.564677 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:06.573393 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:06.574950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:06.576104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b92b03d9-a2cb-400c-a36d-396116ac3d1d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.321192 May 10 17:30:06.576662 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 611/1238] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:06 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:07.595285 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:07.596054 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:07.604482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:07.604945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:07.605738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:07.606364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:07.807322 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:07.817737 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:07.819301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:07.820452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3cf8c93f-07ad-4521-b162-88c2257a4ec1 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.229655 May 10 17:30:07.821206 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 628/1239] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:07 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:08.839071 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:08.839683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:08.847491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:08.847970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:08.848735 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:08.849175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:09.066001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:09.074916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:09.076546 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:09.077765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a9d8068e-8eb7-4c5e-8045-8cfd9dfe4f43 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.242553 May 10 17:30:09.078420 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 612/1240] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:08 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:10.097783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:10.098540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:10.106450 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:10.106915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:10.107705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:10.108149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:10.311466 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:10.320201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:10.321723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:10.322886 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bccafae9-9049-4e62-a6f9-f7fe11958bd8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.230356 May 10 17:30:10.323444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 629/1241] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:10 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:11.341806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:11.342511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:11.349999 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:11.350491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:11.351285 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:11.351730 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:11.556620 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:11.565308 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:11.566879 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:11.568021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3132d8ea-25db-4852-9609-70f3a8c7a554 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.230655 May 10 17:30:11.568577 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 613/1242] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:11 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:12.585779 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:12.586510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:12.593805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:12.594265 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:12.595113 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:12.595563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:12.796992 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:12.806209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:12.807872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:12.809037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d3f18291-7777-4897-93fd-fa969af5ce7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.227134 May 10 17:30:12.809849 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 630/1243] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:12 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:13.827367 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:13.828175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:13.835579 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:13.836166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:13.836833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:13.837276 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:14.042315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:14.052347 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:14.053889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:14.055362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fc3a7eea-374b-4023-8c48-2f036063bc7d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.231558 May 10 17:30:14.057320 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 614/1244] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:13 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:15.074037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:15.074684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:15.082062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:15.082552 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:15.083422 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:15.083875 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:15.290125 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:15.301329 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:15.302878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:15.304031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2eb098f9-5e53-4645-97ea-d2462966e8d8 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.234462 May 10 17:30:15.304830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 631/1245] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:15 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:16.322480 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:16.323090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:16.330239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:16.330724 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:16.331494 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:16.332498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:16.524536 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:16.533201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:16.534753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:16.536481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4563cfbf-d808-46a4-80d3-dd79c9ad1060 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.218266 May 10 17:30:16.537033 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 615/1246] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:16 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:17.554807 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:17.555415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:17.562751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:17.563214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:17.563999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:17.564447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:17.759727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:17.768391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:17.769938 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:17.771095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1aab0efb-1ebd-4378-b56c-f03f9e760cc7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.220755 May 10 17:30:17.771660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 632/1247] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:17 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:18.788807 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:18.789457 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:18.796833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:18.797293 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:18.798075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:18.798563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:18.992091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:19.000754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:19.002404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:19.003733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7fd166e0-6f0b-4502-8a3a-123659ce1024 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.218657 May 10 17:30:19.004410 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 616/1248] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:18 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:20.021532 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:20.022267 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:20.029791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:20.030249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:20.031071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:20.031514 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:20.225606 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:20.235657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:20.237532 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:20.243431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e0b0b711-5bb1-4e13-b0ec-bf6bd4e3c396 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.226328 May 10 17:30:20.246178 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 633/1249] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:20 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:21.263778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:21.264399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:21.272502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:21.272959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:21.273739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:21.274179 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:21.465890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:21.474541 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:21.476062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:21.477187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-67c12018-6f66-4209-a8a0-430efb057fa4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.217219 May 10 17:30:21.477995 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 617/1250] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:21 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:22.495900 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:22.496526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:22.504452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:22.504910 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:22.505691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:22.506131 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:22.700302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:22.708877 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:22.710423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:22.711557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f89836c4-11db-416c-87bf-ebd45b01a6c9 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.220154 May 10 17:30:22.712126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 634/1251] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:22 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:23.729636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:23.730430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:23.737526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:23.737984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:23.738801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:23.739247 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:23.935248 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:23.944924 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:23.946473 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:23.947632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ad0dcc20-1597-451a-afce-95797bdcc904 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.222061 May 10 17:30:23.948397 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 618/1252] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:23 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:24.964629 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:24.965254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:24.972907 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:24.973363 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:24.974151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:24.974630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:25.102028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-0a5e5345-9e6e-42d4-8aae-c21ceeb1f28d req-b5e9b7c8-ef2b-49c6-b1a4-3b735dd0595a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "name": "network-vif-plugged", "status": "completed", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:25.104017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:25.104017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:30:25.114018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-0a5e5345-9e6e-42d4-8aae-c21ceeb1f28d req-b5e9b7c8-ef2b-49c6-b1a4-3b735dd0595a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:25.114502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-0a5e5345-9e6e-42d4-8aae-c21ceeb1f28d req-b5e9b7c8-ef2b-49c6-b1a4-3b735dd0595a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:25.131646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-0a5e5345-9e6e-42d4-8aae-c21ceeb1f28d req-b5e9b7c8-ef2b-49c6-b1a4-3b735dd0595a service nova] Creating event network-vif-plugged:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:30:25.136788 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-0a5e5345-9e6e-42d4-8aae-c21ceeb1f28d req-b5e9b7c8-ef2b-49c6-b1a4-3b735dd0595a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038502 May 10 17:30:25.137381 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 619/1253] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:30:25.179091 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:25.188563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:25.190360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:25.192109 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a2c0defb-33a3-47fe-80a2-95b3f443da27 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.231203 May 10 17:30:25.199494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 635/1254] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:24 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:26.210352 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:26.211099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:26.218570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:26.219079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:26.219958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:26.220428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:26.502101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:26.511336 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:26.512860 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:26.513990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d206e824-1947-4156-b2b6-18d12c46a993 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.307893 May 10 17:30:26.514572 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 620/1255] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:26 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:27.532168 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:27.533185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:27.540137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:27.540594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:27.541372 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:27.541812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:27.685228 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2041144508"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:27.685799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:27.693915 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:27.694418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:27.695218 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:27.695686 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:27.753744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:27.763923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:27.765551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:27.766751 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0cdfbc9c-dbfd-4bf6-be65-0080154981a5 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1731 microversion: 2.20 time: 0.238269 May 10 17:30:27.767315 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 636/1256] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:27 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:30:27.896318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.network.security_group_api [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Removing security group 52a9b31e-985a-4ccf-a0ae-08d8b9c5b3a1 from port 8d45ee84-4b67-4767-8c74-74969170668e May 10 17:30:28.369444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e6d5faf4-7134-4e07-9003-e77e8090856d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action" status: 202 len: 0 microversion: 2.1 time: 0.687897 May 10 17:30:28.376801 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 621/1257] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:30:27 2021] POST /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/action => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:30:28.376989 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-bd8f1e6f-243c-4efb-b8eb-1bd21223f35d req-5c6c76cc-341b-4176-828d-2ca0eedfb7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:28.378925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:28.378925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:30:28.392520 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-bd8f1e6f-243c-4efb-b8eb-1bd21223f35d req-5c6c76cc-341b-4176-828d-2ca0eedfb7e5 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:28.394967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-bd8f1e6f-243c-4efb-b8eb-1bd21223f35d req-5c6c76cc-341b-4176-828d-2ca0eedfb7e5 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:28.418078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-bd8f1e6f-243c-4efb-b8eb-1bd21223f35d req-5c6c76cc-341b-4176-828d-2ca0eedfb7e5 service nova] Creating event network-changed:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:30:28.423945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-bd8f1e6f-243c-4efb-b8eb-1bd21223f35d req-5c6c76cc-341b-4176-828d-2ca0eedfb7e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050730 May 10 17:30:28.425244 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 637/1258] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:30:28.783658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:28.784290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:28.792988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:28.793752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:28.794790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:28.795437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:29.194786 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:29.203681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:29.205205 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:29.206354 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0e0dbb5c-9f4c-453e-8e8c-badc03d5334d tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1718 microversion: 2.20 time: 0.426505 May 10 17:30:29.206952 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 622/1259] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:30:28 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1718 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:30:30.407951 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:30.408544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:30.416459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:30.416923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:30.417705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:30.418151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:30.571597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-c22172f9-149d-48c9-a792-cc52829b0454 req-ed1e7e2a-75a3-4aa9-ae5c-6f26334a9bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:30.573239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:30.573239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:30:30.582821 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c22172f9-149d-48c9-a792-cc52829b0454 req-ed1e7e2a-75a3-4aa9-ae5c-6f26334a9bd6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:30.583204 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-c22172f9-149d-48c9-a792-cc52829b0454 req-ed1e7e2a-75a3-4aa9-ae5c-6f26334a9bd6 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:30.584452 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lazy-loading 'services' on Instance uuid 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:30:30.600663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-c22172f9-149d-48c9-a792-cc52829b0454 req-ed1e7e2a-75a3-4aa9-ae5c-6f26334a9bd6 service nova] Creating event network-changed:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:30:30.606460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-c22172f9-149d-48c9-a792-cc52829b0454 req-ed1e7e2a-75a3-4aa9-ae5c-6f26334a9bd6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171689 May 10 17:30:30.614852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 623/1260] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:30:30.734897 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-391de3e0-b3d2-4061-9a19-1e79e8cbdc59 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments/3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2" status: 202 len: 0 microversion: 2.1 time: 0.330797 May 10 17:30:30.735496 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 638/1261] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:30:30 2021] DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments/3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:30:30.744816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:30.745941 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:30.753986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:30.754542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:30.755524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:30.756136 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:30.832642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3df2dd57-c2de-4cbf-b0f0-d1164d1e5326 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091619 May 10 17:30:30.837970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 624/1262] 10.222.0.32 () {58 vars in 1302 bytes} [Mon May 10 17:30:30 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:30:31.846108 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:31.847297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:31.855070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:31.855530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:31.856316 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:31.856762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:31.919842 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cea4f3b1-1c0a-4d27-af95-3acd505cfda5 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078026 May 10 17:30:31.920403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 639/1263] 10.222.0.32 () {58 vars in 1302 bytes} [Mon May 10 17:30:31 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:30:31.929951 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:31.930484 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:31.937633 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:31.938091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:31.938900 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:31.939343 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:32.096794 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] HTTP exception thrown: Instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb is not attached to volume 3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2 May 10 17:30:32.097885 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Returning 404 to user: Instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb is not attached to volume 3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2 {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:30:32.098764 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-53fee8f1-4320-4e34-889f-35e25be1dfb3 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments/3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2" status: 404 len: 154 microversion: 2.1 time: 0.172646 May 10 17:30:32.099827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 625/1264] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:30:31 2021] DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb/os-volume_attachments/3310ac2f-0b6c-4dae-8bf2-7e0a0bfcebf2 => generated 154 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:30:33.331964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:33.332530 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:33.339905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:33.340358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:33.341130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:33.341569 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:33.402379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:30:33.512647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0f0c3e3d-34af-4b03-a9f3-abb268197927 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 204 len: 0 microversion: 2.1 time: 0.184325 May 10 17:30:33.513279 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 640/1265] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:30:33 2021] DELETE /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:30:33.521290 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:33.521909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:33.529139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:33.529595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:33.530407 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:33.530848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:33.741829 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:33.750164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-725cba12-d9cf-48d8-b4a6-7f7bfdf1a541 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1555 microversion: 2.1 time: 0.232647 May 10 17:30:33.750763 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 626/1266] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:33 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:30:34.769882 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:34.770617 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:34.778077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:34.778566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:34.779345 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:34.779884 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:34.976315 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:34.984931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a469b3ae-0de8-49d4-b0a2-58d051725422 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1555 microversion: 2.1 time: 0.219229 May 10 17:30:34.985698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 641/1267] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:34 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:30:36.002594 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:36.003232 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:36.011175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.011638 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.012460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.013362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.208694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:36.217349 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-28c45016-5a06-45b9-a47c-84d36a7d91c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1555 microversion: 2.1 time: 0.218689 May 10 17:30:36.218121 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 627/1268] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:35 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1555 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:36.523546 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:36.524071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:36.531337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.531793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.532570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.533008 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.594492 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:30:36.719115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7246f1e9-3739-4c17-bb7e-c17d484cd3e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 204 len: 0 microversion: 2.1 time: 0.190478 May 10 17:30:36.719945 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 642/1269] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:30:36 2021] DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:30:36.728531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:36.729275 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:36.736569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.737039 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.738137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.738309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.884636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-3809b352-9567-488c-aaf0-148b7ea2ba3c req-dc8eba23-eec3-477c-aacf-c9d79aa785f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9b02a9-749d-4a9e-bb13-5bc1942e60eb", "name": "network-vif-deleted", "tag": "8d45ee84-4b67-4767-8c74-74969170668e"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:36.886760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:36.886760 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:30:36.903818 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-3809b352-9567-488c-aaf0-148b7ea2ba3c req-dc8eba23-eec3-477c-aacf-c9d79aa785f2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:36.904280 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-3809b352-9567-488c-aaf0-148b7ea2ba3c req-dc8eba23-eec3-477c-aacf-c9d79aa785f2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:36.920638 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-3809b352-9567-488c-aaf0-148b7ea2ba3c req-dc8eba23-eec3-477c-aacf-c9d79aa785f2 service nova] Creating event network-vif-deleted:8d45ee84-4b67-4767-8c74-74969170668e for instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb on hv-cinder-78638 May 10 17:30:36.925245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-3809b352-9567-488c-aaf0-148b7ea2ba3c req-dc8eba23-eec3-477c-aacf-c9d79aa785f2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106428 May 10 17:30:36.926574 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 643/1270] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:30:36.951875 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:36.961301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d933c714-45c9-465f-9a13-9b8cebbc5c01 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1674 microversion: 2.1 time: 0.236780 May 10 17:30:36.961873 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 628/1271] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:36 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:30:37.234682 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:37.235438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:37.243087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:37.243550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:37.244332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:37.244788 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:37.315241 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:37.315620 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:37.316443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lazy-loading 'fault' on Instance uuid 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:30:37.374748 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4013ea2076f458d9ccfc0c90e685093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51cd3a26242746e0abb60baf938aae7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:37.384038 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-50f80d04-7015-4717-8215-a25c8d708ff1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 200 len: 1349 microversion: 2.1 time: 0.153534 May 10 17:30:37.384604 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 644/1272] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:37 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 1349 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:37.978574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:37.979341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:37.986681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:37.987140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:37.987917 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:37.988412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:38.182543 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:38.190741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0762e960-2569-4344-9a17-2e206f23ad09 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1674 microversion: 2.1 time: 0.216166 May 10 17:30:38.191299 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 629/1273] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:37 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:38.401093 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:38.401710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] [instance: 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:38.409544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:38.410024 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:38.411250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:38.411692 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:38.461225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] HTTP exception thrown: Instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb could not be found. May 10 17:30:38.461837 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Returning 404 to user: Instance 2d9b02a9-749d-4a9e-bb13-5bc1942e60eb could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:30:38.462706 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-98297ea4-0b8c-4799-b747-59e73db528c1 tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb" status: 404 len: 111 microversion: 2.1 time: 0.065394 May 10 17:30:38.463275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 645/1274] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:38 2021] GET /compute/v2.1/servers/2d9b02a9-749d-4a9e-bb13-5bc1942e60eb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:30:38.471383 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-bc5caa68-fb0e-4c68-b766-7236d9f8b80d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] Calling method '.version_select at 0x7f41449050d0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:38.494692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-bc5caa68-fb0e-4c68-b766-7236d9f8b80d tempest-TestMinimumBasicScenario-1181547803 tempest-TestMinimumBasicScenario-1181547803-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1303517117" status: 202 len: 0 microversion: 2.1 time: 0.026909 May 10 17:30:38.495451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 630/1275] 10.222.0.32 () {58 vars in 1272 bytes} [Mon May 10 17:30:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1303517117 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:30:39.208784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:39.209448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:39.217754 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:39.218217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:39.219207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:39.219660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:39.404507 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:39.414405 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2e5656b4-3036-46aa-86e3-60010c9295b1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 200 len: 1606 microversion: 2.1 time: 0.210052 May 10 17:30:39.415260 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 646/1276] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:39 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 1606 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:30:39.585903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-e7cd5ede-3f27-4149-9727-d288ea8191c1 req-236ec9ac-e683-4851-9026-d5a01c1fe05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48120777-14d3-4deb-9f45-1146dc41c5c6", "name": "network-vif-deleted", "tag": "efcf780a-b180-4ccf-83b7-ac9d45b35052"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:39.588231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:39.588231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:30:39.604056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-e7cd5ede-3f27-4149-9727-d288ea8191c1 req-236ec9ac-e683-4851-9026-d5a01c1fe05a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:39.604520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-e7cd5ede-3f27-4149-9727-d288ea8191c1 req-236ec9ac-e683-4851-9026-d5a01c1fe05a service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:39.629437 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-e7cd5ede-3f27-4149-9727-d288ea8191c1 req-236ec9ac-e683-4851-9026-d5a01c1fe05a service nova] Creating event network-vif-deleted:efcf780a-b180-4ccf-83b7-ac9d45b35052 for instance 48120777-14d3-4deb-9f45-1146dc41c5c6 on hv-cinder-78638 May 10 17:30:39.636174 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-e7cd5ede-3f27-4149-9727-d288ea8191c1 req-236ec9ac-e683-4851-9026-d5a01c1fe05a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054312 May 10 17:30:39.638103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 631/1277] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:30:40.432355 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:40.433122 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:40.440510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:40.441058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:40.442212 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:40.442915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:40.494128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. May 10 17:30:40.494940 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:30:40.495887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-91fd11f7-74b1-46e5-97c5-50185ea90f6b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 404 len: 111 microversion: 2.1 time: 0.067916 May 10 17:30:40.496462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 647/1278] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:40 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:30:40.505966 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2dd6fb96-7df9-4739-808f-e86df3087e0b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '.version_select at 0x7f414457cee0>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:40.524028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2dd6fb96-7df9-4739-808f-e86df3087e0b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224096963" status: 202 len: 0 microversion: 2.1 time: 0.022526 May 10 17:30:40.524692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 632/1279] 10.222.0.32 () {58 vars in 1221 bytes} [Mon May 10 17:30:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224096963 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:30:41.678871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: .version_select at 0x7f414527cf70>, body: {"keypair": {"name": "tempest-keypair-1022680551"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:41.704704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:30:41.708676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:30:41.825797 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:30:41.829686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:30:41.842959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-621e667f-3ca3-4103-a198-fb0a92344e43 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.168372 May 10 17:30:41.849410 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 648/1280] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 10 17:30:41 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:43.705040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-16425552", "imageRef": "c4dc378b-3a9a-4406-ac46-09a5a965ab10", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64b55f2c-b19a-482d-8023-f6baaecf0a48"}], "security_groups": [{"name": "tempest-securitygroup--1359128719"}], "key_name": "tempest-keypair-1022680551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:43.999506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] validate_networks() for [('64b55f2c-b19a-482d-8023-f6baaecf0a48', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:30:44.872527 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:30:44.873135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:30:44.873587 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:30:44.874007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:30:44.874455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:30:44.882919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:44.883413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:44.884239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:44.884741 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:44.902702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for project aca5e614d86048998dd46f3226b6b322. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:30:44.906721 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Getting quotas for user c8e2337f4dc6419899c7ae68538069ea and project aca5e614d86048998dd46f3226b6b322. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:30:44.918127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:30:44.920598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c4dc378b-3a9a-4406-ac46-09a5a965ab10',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:30:44.964339 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ed4f1094-d9a5-4ff0-b549-b3d6b058e9c1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.263377 May 10 17:30:44.964998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 633/1281] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:30:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 1265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:30:44.976942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-04d3db1b-134f-4d5d-979d-10ac445af5fe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:44.978209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-04d3db1b-134f-4d5d-979d-10ac445af5fe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:45.059066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-04d3db1b-134f-4d5d-979d-10ac445af5fe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:45.068440 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-04d3db1b-134f-4d5d-979d-10ac445af5fe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1236 microversion: 2.1 time: 0.097111 May 10 17:30:45.069270 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 649/1282] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:44 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:30:46.085366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:46.085978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:46.095194 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:46.095656 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:46.096451 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:46.096895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:46.221986 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:46.231341 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0003847c-9a59-4d08-9860-751290b79052 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1296 microversion: 2.1 time: 0.150019 May 10 17:30:46.231920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 634/1283] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:46 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1296 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:47.247940 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:47.248549 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:47.256548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:47.257009 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:47.257805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:47.258251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:47.372705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:47.381337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bd93f6dd-db9b-46dc-9393-728d443e24ae tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1294 microversion: 2.1 time: 0.137113 May 10 17:30:47.381918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 650/1284] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:47 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1294 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:48.399196 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:48.400532 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:48.408187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:48.408955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:48.409970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:48.410679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:48.621263 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:48.630851 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1cf8039a-16b7-4f6a-a602-d8caf9347489 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.236082 May 10 17:30:48.631753 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 635/1285] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:48 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:49.647923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:49.648483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:49.655909 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:49.656367 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:49.657157 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:49.657597 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:49.867867 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:49.881096 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9c02925f-4911-43c5-b9e9-113e4a702c31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.237519 May 10 17:30:49.881967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 651/1286] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:49 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:50.053386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-7702b54d-14a2-4d01-aba2-3d7b70568a3d req-40b58e57-50e3-43af-b69f-8b82c2e42e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44142629-166e-485c-a8a1-e5e8a09c57d2", "tag": "0ffa314b-06b8-4f2e-805a-998275908105"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:50.056446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:50.056446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:30:50.069198 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7702b54d-14a2-4d01-aba2-3d7b70568a3d req-40b58e57-50e3-43af-b69f-8b82c2e42e56 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:50.069661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7702b54d-14a2-4d01-aba2-3d7b70568a3d req-40b58e57-50e3-43af-b69f-8b82c2e42e56 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:50.096542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-7702b54d-14a2-4d01-aba2-3d7b70568a3d req-40b58e57-50e3-43af-b69f-8b82c2e42e56 service nova] Creating event network-changed:0ffa314b-06b8-4f2e-805a-998275908105 for instance 44142629-166e-485c-a8a1-e5e8a09c57d2 on hv-cinder-78638 May 10 17:30:50.101500 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-7702b54d-14a2-4d01-aba2-3d7b70568a3d req-40b58e57-50e3-43af-b69f-8b82c2e42e56 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052415 May 10 17:30:50.102107 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 636/1287] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:30:50.898565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:50.899942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:50.907813 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:50.908508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:50.909474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:50.910128 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:51.401982 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:51.410962 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-35eb8ca0-6ef5-4683-9b51-19a72b3757c6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.516274 May 10 17:30:51.420482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 652/1288] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:50 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:52.429139 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:52.429787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:52.437574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:52.438270 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:52.439142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:52.439768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:52.918856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:52.928318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-02696983-b68c-44f8-aab5-a02217a5feb8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.504054 May 10 17:30:52.929037 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 637/1289] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:52 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:53.944913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:53.945536 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:53.952900 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:53.953360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:53.954151 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:53.954636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:54.149758 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:54.157866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-209a0873-4fcc-41c6-a4a0-6a6c52cab732 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.217320 May 10 17:30:54.158461 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 653/1290] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:53 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:55.176004 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:55.176712 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:55.183930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:55.184391 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:55.185163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:55.185593 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:55.378871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:55.386929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f98c49bd-282e-43ff-b2a3-0c4a5dedcb7a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.215286 May 10 17:30:55.387491 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 638/1291] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:55 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:56.403939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:56.404566 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:56.412392 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:56.412856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:56.413639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:56.414090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:56.611571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:56.619728 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eef63cd6-9bcb-49c3-b5c2-999d21c50b0e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.219538 May 10 17:30:56.620298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 654/1292] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:56 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:57.234079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-17d270f0-4a24-4590-9b91-f746699cca7d req-5edd26ff-8767-4e10-bd1b-498a9cfaf317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44142629-166e-485c-a8a1-e5e8a09c57d2", "name": "network-vif-plugged", "status": "completed", "tag": "0ffa314b-06b8-4f2e-805a-998275908105"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:30:57.235697 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:30:57.235697 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:30:57.246949 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-17d270f0-4a24-4590-9b91-f746699cca7d req-5edd26ff-8767-4e10-bd1b-498a9cfaf317 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:57.247403 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-17d270f0-4a24-4590-9b91-f746699cca7d req-5edd26ff-8767-4e10-bd1b-498a9cfaf317 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:57.263050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-17d270f0-4a24-4590-9b91-f746699cca7d req-5edd26ff-8767-4e10-bd1b-498a9cfaf317 service nova] Creating event network-vif-plugged:0ffa314b-06b8-4f2e-805a-998275908105 for instance 44142629-166e-485c-a8a1-e5e8a09c57d2 on hv-cinder-78638 May 10 17:30:57.268179 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-17d270f0-4a24-4590-9b91-f746699cca7d req-5edd26ff-8767-4e10-bd1b-498a9cfaf317 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037437 May 10 17:30:57.268709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 639/1293] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:30:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:30:57.636557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:57.637186 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:57.644868 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:57.645320 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:57.646095 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:57.646683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:57.842029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:57.850814 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-769dd9e1-d09b-49b3-8fee-84a9b236ba0d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.217917 May 10 17:30:57.851380 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 655/1294] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:57 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:30:58.867948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:30:58.868658 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:30:58.877779 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:58.878241 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:58.879540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:30:58.879979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:30:59.082943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:30:59.091353 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d725aa5a-1e55-467c-a168-5e894c92c1cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1362 microversion: 2.1 time: 0.227571 May 10 17:30:59.092164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 640/1295] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:30:58 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:31:00.108220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:00.108848 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:00.116185 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:00.116641 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:00.117413 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:00.117854 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:00.307673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:00.315805 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8fba2936-eb9e-4530-bf8b-e95c74776ed6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1548 microversion: 2.1 time: 0.211365 May 10 17:31:00.316373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 656/1296] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:31:00 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:31:00.331642 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:00.332137 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:00.339362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:00.339827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:00.340606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:00.341046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:00.487307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-39fa916f-5837-46f6-9554-969175160065 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159404 May 10 17:31:00.487903 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 641/1297] 10.222.0.32 () {58 vars in 1275 bytes} [Mon May 10 17:31:00 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:31:02.008725 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:02.009710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:02.010120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-4bcc140d-4e70-4c2f-b002-e8adada8d9ad req-447878f7-ccc5-478d-ae6f-4d7679303592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44142629-166e-485c-a8a1-e5e8a09c57d2", "tag": "0ffa314b-06b8-4f2e-805a-998275908105"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:02.011646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:31:02.011646 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:31:02.018391 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:02.019134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:02.019878 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-4bcc140d-4e70-4c2f-b002-e8adada8d9ad req-447878f7-ccc5-478d-ae6f-4d7679303592 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:02.020372 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-4bcc140d-4e70-4c2f-b002-e8adada8d9ad req-447878f7-ccc5-478d-ae6f-4d7679303592 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:02.020855 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:02.021519 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:02.036628 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-4bcc140d-4e70-4c2f-b002-e8adada8d9ad req-447878f7-ccc5-478d-ae6f-4d7679303592 service nova] Creating event network-changed:0ffa314b-06b8-4f2e-805a-998275908105 for instance 44142629-166e-485c-a8a1-e5e8a09c57d2 on hv-cinder-78638 May 10 17:31:02.041423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-4bcc140d-4e70-4c2f-b002-e8adada8d9ad req-447878f7-ccc5-478d-ae6f-4d7679303592 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 May 10 17:31:02.044251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 642/1298] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:31:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:31:02.146300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1d3ce112-922e-4a93-806c-d4bfd3e605dd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.140534 May 10 17:31:02.149714 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 657/1299] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:02 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:03.157836 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:03.158892 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:03.167401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:03.167591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:03.168379 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:03.168816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:03.289621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-54eb8d86-430d-4e2f-bc14-0685d6863a80 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.135810 May 10 17:31:03.292661 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 643/1300] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:03 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:04.300709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:04.302358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:04.310370 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:04.310827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:04.311669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:04.312120 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:04.440025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-56488366-0bd3-43ce-8eee-9de43ed4f647 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.143605 May 10 17:31:04.440625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 658/1301] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:04 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:05.452582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:05.453595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:05.461446 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:05.461901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:05.462707 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:05.463151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:05.588747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-5724d6bd-25ce-4338-ac0c-3caacf8955de tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.140265 May 10 17:31:05.589480 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 644/1302] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:05 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:06.601063 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:06.602078 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:06.610248 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:06.610744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:06.611526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:06.611973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:06.726571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-17ec553f-9c0d-4a86-b61b-2919e540efde tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.130404 May 10 17:31:06.727184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 659/1303] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:06 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:07.738570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:07.740074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:07.747893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:07.748351 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:07.749135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:07.749578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:07.863771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fb4b69eb-44b7-4a84-aa91-365b2527ee68 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.129412 May 10 17:31:07.864380 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 645/1304] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:07 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:08.875210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:08.876224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:08.884735 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:08.885200 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:08.885987 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:08.886463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:08.998059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e61bf796-2029-4495-af11-78a0684115ee tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.126887 May 10 17:31:09.001201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 660/1305] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:08 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:10.009444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:10.010482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:10.018377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:10.018833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:10.019613 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:10.020073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:10.135584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7c1b59a5-65cc-47f7-8c16-869f6a0e6ab6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.130789 May 10 17:31:10.136191 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 646/1306] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:10 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:11.147618 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:11.148658 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:11.156556 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:11.157013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:11.157784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:11.158229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:11.288798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-64660840-6972-4042-9282-d8004a5b9af4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 14 microversion: 2.1 time: 0.145878 May 10 17:31:11.289425 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 661/1307] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:11 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:31:12.299981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:12.300914 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:12.309435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:12.309896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:12.310722 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:12.311169 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:12.435384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-91f7487e-8350-41d2-ad26-d8d2b67b842a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 10009 microversion: 2.1 time: 0.139424 May 10 17:31:12.436031 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 647/1308] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:12 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 10009 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:13.447694 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:13.448699 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:13.456771 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:13.457228 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:13.458783 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:13.459581 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:13.601211 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5e058509-f264-4581-9e2a-1447a351ba37 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 17861 microversion: 2.1 time: 0.157472 May 10 17:31:13.601865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 662/1309] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:13 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 17861 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:14.613487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:14.615020 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:14.622895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:14.623346 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:14.624117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:14.624553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:14.757728 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b8e2bbe4-780c-4734-8b6c-e15c749669a6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 19096 microversion: 2.1 time: 0.148305 May 10 17:31:14.758362 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 648/1310] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:14 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 19096 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:15.769621 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:15.770660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:15.778610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:15.779066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:15.779843 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:15.780286 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:15.909278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-0efe360b-37d4-4ebe-8d28-3fbfcbc1639f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 21344 microversion: 2.1 time: 0.143851 May 10 17:31:15.909889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 663/1311] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:15 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 21344 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:16.921294 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:16.922366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:16.930803 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:16.931264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:16.932055 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:16.932503 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:17.205458 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-0fe7f813-3513-4b63-926d-0ff9dd5618cf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 23235 microversion: 2.1 time: 0.288150 May 10 17:31:17.206035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 649/1312] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:16 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 23235 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:18.217677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:18.218712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:18.227268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:18.227969 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:18.228774 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:18.229220 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:18.359346 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-60e49404-f3a4-4925-9ca4-1283b37c5185 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 24553 microversion: 2.1 time: 0.145941 May 10 17:31:18.359963 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 664/1313] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:18 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 24553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:31:19.370770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:19.371774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:19.380081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:19.380531 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:19.381560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:19.382000 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:19.503202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8b476313-916e-48b3-92f4-c6b3cf85f7eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 26185 microversion: 2.1 time: 0.136427 May 10 17:31:19.503963 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 650/1314] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:19 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 26185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:20.515968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:20.516972 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:20.524921 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:20.525378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:20.526147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:20.526614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:20.652330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-a627a752-06d1-4346-9259-b2d26ab8481b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 27530 microversion: 2.1 time: 0.140225 May 10 17:31:20.652976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 665/1315] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:20 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 27530 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:21.663595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:21.664634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:21.672548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:21.673008 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:21.673791 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:21.674236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:21.802984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1f2e8c4c-c723-4f7a-9fe9-6414d64df9ed tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 27932 microversion: 2.1 time: 0.143432 May 10 17:31:21.803604 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 651/1316] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:21 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 27932 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:22.815124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:22.816148 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:22.824993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:22.825475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:22.826426 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:22.826906 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:22.966631 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b331f070-4392-4129-9bc9-bca472ef2b7f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28266 microversion: 2.1 time: 0.155437 May 10 17:31:22.967288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 666/1317] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:22 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:23.979027 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:23.980058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:23.987923 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:23.988384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:23.989789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:23.990226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:24.114555 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f16164b8-7c18-412e-9a42-8ba9749c8ded tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.139854 May 10 17:31:24.115198 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 652/1318] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:23 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:25.126603 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:25.127615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:25.136125 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:25.136583 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:25.137357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:25.137798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:25.260656 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5ffea864-3a36-4302-b7ed-b3d4688da8be tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.138072 May 10 17:31:25.261312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 667/1319] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:25 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:26.272930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:26.273955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:26.281771 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:26.282220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:26.283022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:26.283460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:26.414030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dfd1f87f-3f36-40cb-9fe9-07f9c8e2c717 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.145095 May 10 17:31:26.414694 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 653/1320] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:26 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:27.426700 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:27.427734 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:27.435572 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:27.436028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:27.436835 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:27.437277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:27.557712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b1b9841a-6643-4407-af1b-cd905d31702c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.135601 May 10 17:31:27.558356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 668/1321] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:27 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:28.570210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:28.571268 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:28.579162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:28.579624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:28.580402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:28.580845 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:28.698670 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-145e24c7-e8b2-418e-a9d2-d9dc97751029 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.133010 May 10 17:31:28.699286 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 654/1322] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:28 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:29.710976 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:29.711990 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:29.720135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:29.720593 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:29.721383 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:29.721832 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:29.836481 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2a0119f5-76f2-489b-8cfe-02bfeb08d52a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.129725 May 10 17:31:29.837099 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 669/1323] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:29 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:30.848857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:30.849880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:30.858117 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:30.858606 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:30.859377 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:30.859816 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:30.978611 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6acf2c76-8283-407f-aa32-5ecd8f491c12 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.133345 May 10 17:31:30.979222 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 655/1324] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:30 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:31.990917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:31.991954 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:31.999759 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:32.000217 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:32.000993 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:32.001438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:32.120158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2992d7e0-a27b-4754-b18d-97042ea284ac tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.133717 May 10 17:31:32.120794 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 670/1325] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:31 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:33.132889 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:33.133891 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:33.141702 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:33.142156 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:33.142964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:33.143405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:33.269235 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-596e351d-1844-4c50-bb34-a92b10678552 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.140888 May 10 17:31:33.270487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 656/1326] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:33 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:34.281863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:34.282889 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:34.291387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.291851 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:34.292650 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.293085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:34.414561 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e5ce6b51-5444-450f-bb73-7987de02bcb7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.136687 May 10 17:31:34.415182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 671/1327] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:34 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:34.610356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:34.610972 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:34.619322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.619780 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:34.620551 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.620988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:34.681922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:31:34.788600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-57e31ec8-2124-45eb-89d4-3362ace3012c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 204 len: 0 microversion: 2.20 time: 0.182101 May 10 17:31:34.789374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 657/1328] 10.222.0.32 () {60 vars in 1280 bytes} [Mon May 10 17:31:34 2021] DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:31:34.798305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:34.799068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:34.807002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.807463 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:34.808238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:34.808683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:35.003482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:35.012836 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:35.014415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:35.015568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7ac053cc-a7c0-4433-a0ba-7bc4c1e84825 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.221486 May 10 17:31:35.016135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 672/1329] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:31:34 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:31:35.426718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:35.427726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:35.434909 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:35.435364 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:35.436133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:35.436571 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:35.558435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-527bc066-8a98-4e7e-94f3-822f7bf31296 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.135693 May 10 17:31:35.559099 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 658/1330] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:35 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:36.032984 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:36.033633 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:36.041307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:36.041766 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:36.042571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:36.043020 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:36.240223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:36.248745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:36.250257 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:36.251415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-303a4f39-d6f0-482b-b8b9-8637bc932625 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1724 microversion: 2.20 time: 0.222242 May 10 17:31:36.251967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 673/1331] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:31:36 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:31:36.571151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:36.572151 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:36.579907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:36.580358 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:36.581135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:36.581572 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:36.700269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2a1db452-842e-4c41-9780-d2b2afce2cb3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28310 microversion: 2.1 time: 0.133637 May 10 17:31:36.701598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 659/1332] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:36 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28310 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:37.268925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:37.270057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:37.277277 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:37.277733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:37.278539 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:37.278979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:37.418555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:37.427390 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:37.429238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:37.430994 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f044a9f1-b460-44e0-a31e-1dd049305635 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1657 microversion: 2.20 time: 0.165248 May 10 17:31:37.431385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 674/1333] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:31:37 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1657 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:31:37.713180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:37.714198 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:37.722068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:37.722563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:37.723345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:37.723789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:37.856264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-65710ffe-8105-4502-aa56-88285806e096 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28601 microversion: 2.1 time: 0.147169 May 10 17:31:37.857466 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 660/1334] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:37 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:37.965528 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-f838a143-c877-42fd-b5e1-564b3f59b2ca req-6c2c22d2-deeb-4385-bc19-87cfc0d9e227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b181282d-1624-4f3e-a6c7-5fb448435bcd", "name": "network-vif-deleted", "tag": "c41c7396-5129-403a-b942-2a503f859e3c"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:37.967182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:31:37.967182 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:31:37.976421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-f838a143-c877-42fd-b5e1-564b3f59b2ca req-6c2c22d2-deeb-4385-bc19-87cfc0d9e227 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:37.976864 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-f838a143-c877-42fd-b5e1-564b3f59b2ca req-6c2c22d2-deeb-4385-bc19-87cfc0d9e227 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:37.995116 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-f838a143-c877-42fd-b5e1-564b3f59b2ca req-6c2c22d2-deeb-4385-bc19-87cfc0d9e227 service nova] Creating event network-vif-deleted:c41c7396-5129-403a-b942-2a503f859e3c for instance b181282d-1624-4f3e-a6c7-5fb448435bcd on hv-cinder-78638 May 10 17:31:37.999532 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-f838a143-c877-42fd-b5e1-564b3f59b2ca req-6c2c22d2-deeb-4385-bc19-87cfc0d9e227 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038213 May 10 17:31:38.000489 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 675/1335] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:31:38.449404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:38.450113 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:38.458621 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:38.459202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:38.459977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:38.460415 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:38.536414 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:38.536862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:38.537313 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.objects.instance [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lazy-loading 'fault' on Instance uuid b181282d-1624-4f3e-a6c7-5fb448435bcd {{(pid=92809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:31:38.620490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:38.630580 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:38.632100 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd07c4ff6a47645d184b80d15a81d77d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb915c4b01148a7b37b3577f122af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:31:38.633428 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-313c158c-b407-4081-b307-7d913613270c tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 200 len: 1372 microversion: 2.20 time: 0.188294 May 10 17:31:38.633985 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 661/1336] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:31:38 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:31:38.869398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:38.870626 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:38.878632 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:38.879100 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:38.879887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:38.880366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:39.001707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-72cab726-da2c-4b31-87b8-7d2050fc5ac7 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28601 microversion: 2.1 time: 0.136228 May 10 17:31:39.003224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 676/1337] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:38 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28601 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:31:39.651853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:39.652417 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:39.659958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:39.660412 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:39.661178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:39.661616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:39.709616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. May 10 17:31:39.710212 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:31:39.711053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-82d6cba4-8d45-429e-9091-d63090b697c4 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 404 len: 111 microversion: 2.20 time: 0.063133 May 10 17:31:39.711585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 662/1338] 10.222.0.32 () {60 vars in 1277 bytes} [Mon May 10 17:31:39 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:31:39.720489 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-5cb4f11c-a017-4716-9855-084ab0f11d0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '.version_select at 0x7f4144f7ca60>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:39.737594 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-5cb4f11c-a017-4716-9855-084ab0f11d0b tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114086752" status: 204 len: 0 microversion: 2.20 time: 0.021273 May 10 17:31:39.738140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 677/1339] 10.222.0.32 () {60 vars in 1262 bytes} [Mon May 10 17:31:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114086752 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 17:31:40.013157 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:40.014242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:40.021529 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:40.021984 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:40.022790 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:40.023231 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:40.159837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6aad4e76-fe72-42d0-b460-9f66b336eebe tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.150208 May 10 17:31:40.160766 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 663/1340] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:40 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:41.172118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:41.174506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:41.183253 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:41.183722 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:41.184510 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:41.184959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:41.308927 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-54963ce8-39a2-4a3d-beda-b1850be22682 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.140771 May 10 17:31:41.309483 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 678/1341] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:41 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:41.931398 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:41.932019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:41.939969 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:41.940419 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:41.941666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:41.942109 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:41.990120 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. May 10 17:31:41.990814 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:31:41.991631 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-34d64cee-bac6-44fc-9c8d-bf13ac31a77e tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 404 len: 111 microversion: 2.1 time: 0.064495 May 10 17:31:41.992163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 664/1342] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:31:41 2021] DELETE /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:31:42.000570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:42.001275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: b181282d-1624-4f3e-a6c7-5fb448435bcd] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:42.009595 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:42.010055 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:42.010869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:42.011308 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:42.059499 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. May 10 17:31:42.060112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance b181282d-1624-4f3e-a6c7-5fb448435bcd could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:31:42.060952 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-68b01e22-0fd6-44d9-a29c-b877b4a4e3a7 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd" status: 404 len: 111 microversion: 2.1 time: 0.064525 May 10 17:31:42.061512 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 679/1343] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:31:41 2021] GET /compute/v2.1/servers/b181282d-1624-4f3e-a6c7-5fb448435bcd => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:31:42.320855 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:42.322017 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:42.329229 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:42.329675 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:42.330480 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:42.330919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:42.448360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7feae5d5-c672-441f-9d35-fd4efc3d18e5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.131621 May 10 17:31:42.448907 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 665/1344] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:42 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:43.300201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:43.300679 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:43.308654 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.309115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.309894 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.310352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.359300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. May 10 17:31:43.359887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:31:43.360709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95086625-22a3-4914-a1c6-42d113c3e0b3 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 404 len: 111 microversion: 2.1 time: 0.064357 May 10 17:31:43.361250 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 680/1345] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:31:43 2021] DELETE /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:31:43.369652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:31:43.370389 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] [instance: 9ac86cf8-f933-474a-9e63-aef9cd2041d0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:43.378149 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.378632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.379901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.380345 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.427566 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] HTTP exception thrown: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. May 10 17:31:43.428159 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] Returning 404 to user: Instance 9ac86cf8-f933-474a-9e63-aef9cd2041d0 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:31:43.428979 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-33ed1206-2f15-4e42-b193-434cff904761 tempest-AttachVolumeShelveTestJSON-1212993230 tempest-AttachVolumeShelveTestJSON-1212993230-project] 10.222.0.32 "GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0" status: 404 len: 111 microversion: 2.1 time: 0.063474 May 10 17:31:43.429492 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 666/1346] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:31:43 2021] GET /compute/v2.1/servers/9ac86cf8-f933-474a-9e63-aef9cd2041d0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:31:43.460944 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:43.461972 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:43.469141 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.469693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.470577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:43.471090 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:43.590098 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95db0da8-9ece-4dd6-a1b2-b1049f2cf817 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.133118 May 10 17:31:43.594130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 681/1347] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:43 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:44.602502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:44.603797 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:44.611392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:44.611943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:44.612732 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:44.613180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:44.731901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-baa92bf2-7798-4c90-a1d1-847f04775e9b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.133063 May 10 17:31:44.732671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 667/1348] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:44 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:45.744482 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:45.745615 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:45.753415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:45.754375 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:45.755649 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:45.755649 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:45.883671 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9c641205-abb4-488f-9b04-c862bb520b45 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.143246 May 10 17:31:45.884568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 682/1349] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:45 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:46.896274 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:46.897252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:46.905140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:46.905627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:46.906448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:46.906901 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:47.038948 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-1f0d5e20-3a0a-43ab-8239-ad627930330b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.146908 May 10 17:31:47.040599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 668/1350] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:46 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:48.054610 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:48.056926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:48.070475 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:48.071668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:48.073224 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:48.074238 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:48.208195 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9bdd0875-838a-43b5-b7ab-223116df0d6e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.159472 May 10 17:31:48.209040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 683/1351] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:48 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:49.221304 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:49.222418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:49.230569 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:49.231028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:49.231847 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:49.232325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:49.356128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-4629b11d-7a24-479e-84bb-55d0f0c6c1ca tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.138830 May 10 17:31:49.359970 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 669/1352] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:49 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:50.369904 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:50.371076 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:50.379403 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:50.379866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:50.380661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:50.381149 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:50.500254 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b247ed73-2b9e-4ef4-aff9-b7110ab869ab tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.135199 May 10 17:31:50.500988 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 684/1353] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:50 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:51.512485 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:51.513668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:51.522170 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:51.522787 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:51.523644 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:51.524162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:51.654795 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b38eab2a-4a00-4230-b269-438e87531bff tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.140796 May 10 17:31:51.655765 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 670/1354] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:51 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:52.667500 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:52.668630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:52.676513 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:52.676979 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:52.677763 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:52.678214 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:52.798379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c8763fd3-d366-44be-a9d0-d59d74ab5a5b tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.134764 May 10 17:31:52.802625 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 685/1355] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:52 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:53.811011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:53.811937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:53.819718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:53.820180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:53.820952 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:53.821392 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:53.937688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c17da100-d8fa-4eec-9f94-4b51c312b56a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.130835 May 10 17:31:53.938325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 671/1356] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:53 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:54.949635 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:54.950614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:54.958661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:54.959126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:54.959912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:54.960360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:55.076773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b89b41fe-2794-448f-b811-aecb5a0e1507 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.131141 May 10 17:31:55.077439 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 686/1357] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:54 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:56.088973 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:56.090024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:56.098226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:56.098775 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:56.099637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:56.100116 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:56.217717 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ddce4c16-5aba-4bd9-846f-e6b814c067eb tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.132989 May 10 17:31:56.218626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 672/1358] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:56 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:57.230301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:57.231294 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:57.239733 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:57.240191 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:57.240973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:57.241423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:57.354010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-57de360f-7bed-4c5b-9337-f947775c4df9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.128063 May 10 17:31:57.354936 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 687/1359] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:57 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:31:58.366356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:58.367385 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:58.375164 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:58.375619 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:58.376396 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:58.376838 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:58.497336 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-80f51871-ec0c-419f-b99d-b53d19e7e4b9 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.135257 May 10 17:31:58.497935 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 673/1360] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:58 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:31:59.509718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:31:59.510762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:31:59.518686 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:59.519145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:59.519918 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:31:59.520359 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:31:59.638582 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f6f4ad66-2cfc-4fb9-ab5a-4ebce28299da tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.132796 May 10 17:31:59.639584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 688/1361] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:31:59 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:00.651239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:00.652462 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:00.661368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:00.661880 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:00.662716 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:00.663167 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:00.782357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6eab5b38-7166-4c65-bfcb-31d2506e9c88 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.135092 May 10 17:32:00.783040 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 674/1362] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:00 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:01.794955 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:01.795960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:01.803941 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:01.804406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:01.805198 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:01.805644 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:01.922046 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-53493878-d280-4341-a451-4b5b4ba42b6f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.130953 May 10 17:32:01.926013 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 689/1363] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:01 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:02.934279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:02.935315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:02.943864 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:02.944325 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:02.945172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:02.945617 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:03.064562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2187437a-b27b-4c6d-98c2-3f667d9c6016 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.134281 May 10 17:32:03.065216 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 675/1364] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:02 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:32:04.077396 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:04.078460 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:04.086999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:04.087455 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:04.088230 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:04.088676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:04.208586 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-b70fb712-b680-4a7c-b8eb-7cf38ee587a2 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.135339 May 10 17:32:04.209204 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 690/1365] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:04 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:32:05.220736 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:05.221805 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:05.230560 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:05.231021 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:05.231800 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:05.232244 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:05.349666 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-42cfdf03-d16b-4690-95a7-8d6de637d608 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.133000 May 10 17:32:05.350291 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 676/1366] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:05 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:06.361905 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:06.363502 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:06.371419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:06.371876 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:06.372659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:06.373103 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:06.493334 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6d94047d-1ff1-4825-b502-b1653c3e3aa8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.135454 May 10 17:32:06.493942 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 691/1367] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:06 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:07.505958 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:07.507044 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:07.514664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:07.515123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:07.515904 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:07.516346 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:07.634018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-469e7575-5f1e-44ed-83f0-b0f0da9ec855 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.132053 May 10 17:32:07.634752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 677/1368] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:07 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:08.646042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:08.647135 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:08.654974 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:08.655436 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:08.656213 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:08.656657 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:08.773531 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-067fa497-0afa-434d-ae1a-7db32aae1270 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.131432 May 10 17:32:08.774223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 692/1369] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:08 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:09.785932 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:09.787003 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:09.795307 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:09.795772 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:09.796570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:09.797035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:09.915537 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-aedc2cda-3127-4eac-b287-b6f30b55897a tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.133728 May 10 17:32:09.917043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 678/1370] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:09 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:10.927705 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:10.929373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:10.937193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:10.937652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:10.938470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:10.938912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:11.061669 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8e6752c8-9400-4f45-bc5b-caf7209ce52c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 28769 microversion: 2.1 time: 0.138398 May 10 17:32:11.062446 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 693/1371] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:10 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 28769 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:12.073687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:12.074928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:12.083401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:12.083857 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:12.084672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:12.085449 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:12.213132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f462ba3c-9136-48a7-93aa-217962a35571 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 30341 microversion: 2.1 time: 0.143475 May 10 17:32:12.214663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 679/1372] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:12 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 30341 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:13.225554 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:13.226614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:13.234841 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:13.235312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:13.236112 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:13.236565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:13.375996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aba62575-2820-4de7-9b33-a038efa1ca31 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 32228 microversion: 2.1 time: 0.154509 May 10 17:32:13.376872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 694/1373] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:13 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 32228 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:14.388953 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:14.389959 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:14.398309 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:14.398806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:14.399589 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:14.400034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:14.524176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-85aeee4f-ae56-4400-9c0c-fc018972a466 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 33363 microversion: 2.1 time: 0.139180 May 10 17:32:14.524730 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 680/1374] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:14 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 33363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:15.536126 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:15.537145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:15.545158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:15.545622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:15.546429 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:15.546877 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:15.811791 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3894d181-066c-43a0-ab9d-e5386eb30903 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 34803 microversion: 2.1 time: 0.280089 May 10 17:32:15.816031 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 695/1375] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:15 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 34803 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:16.823401 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:16.824441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:16.833018 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:16.833477 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:16.834260 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:16.834739 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:16.961679 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b69e9a78-f114-4a42-a8ba-ca41cf9532f0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 36131 microversion: 2.1 time: 0.142224 May 10 17:32:16.962368 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 681/1376] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:16 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 36131 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:17.973550 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:17.974661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:17.983025 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:17.983429 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:17.984221 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:17.984667 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:18.107342 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-99ba91d5-59eb-47b8-92fa-af109f951a89 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 37903 microversion: 2.1 time: 0.137678 May 10 17:32:18.107990 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 696/1377] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:17 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 37903 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:19.120305 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:19.121360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:19.129837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:19.130295 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:19.131140 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:19.131591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:19.266783 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f9910f53-2d59-4ee9-97d1-e71cd9c124f4 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 38295 microversion: 2.1 time: 0.150772 May 10 17:32:19.267467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 682/1378] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:19 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 38295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:20.279874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:20.281441 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:20.290412 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:20.290898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:20.291693 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:20.292142 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:20.412305 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8cad82fa-4edb-459f-8f19-a6cf129ae1bd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 38295 microversion: 2.1 time: 0.136422 May 10 17:32:20.416996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 697/1379] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:20 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 38295 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:21.425929 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:21.427398 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:21.436142 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:21.436597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:21.437384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:21.437825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:21.561225 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c7ffafa2-ad9e-431d-9b9b-334167d7f887 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 38295 microversion: 2.1 time: 0.139805 May 10 17:32:21.561913 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 683/1380] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:21 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 38295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:22.573870 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:22.575664 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:22.585085 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:22.585551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:22.586557 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:22.587011 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:22.726880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-1190ce81-9f6f-484d-9d92-6e71dbe5358f tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 38295 microversion: 2.1 time: 0.156957 May 10 17:32:22.727973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 698/1381] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:22 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 38295 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:23.740384 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:23.741344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:23.749238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:23.749697 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:23.750512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:23.750955 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:23.872709 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-da2c274c-9fe8-4090-ab0a-a46c456504cd tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action" status: 200 len: 38422 microversion: 2.1 time: 0.137074 May 10 17:32:23.873360 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 684/1382] 10.222.0.32 () {60 vars in 1278 bytes} [Mon May 10 17:32:23 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/action => generated 38422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:32:23.883863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:23.884487 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:23.892293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:23.892758 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:23.894067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:23.894544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:23.950541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-35f30c59-bda5-452d-bc90-893878ef6498 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/ips" status: 200 len: 146 microversion: 2.1 time: 0.070751 May 10 17:32:23.951147 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 699/1383] 10.222.0.32 () {58 vars in 1248 bytes} [Mon May 10 17:32:23 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/ips => generated 146 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:25.542058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa7c7a8c-324d-4a96-8ec5-d592c9300472"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:25.543328 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:25.551522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:25.551976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:25.552768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:25.553217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:25.955597 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-06ab7d56-9740-4329-bfe3-d9d3b45971a8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417544 May 10 17:32:25.956820 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 685/1384] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:32:25 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:33.911926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:33.912871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:33.932929 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:33.933124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:33.934511 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:33.935395 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:34.036571 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4799b1f6-8812-475b-b1bd-5f10196b3a26 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128474 May 10 17:32:34.037683 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 700/1385] 10.222.0.32 () {58 vars in 1302 bytes} [Mon May 10 17:32:33 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:34.051856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:34.053418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:34.072101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:34.072752 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:34.074101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:34.074758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:34.158146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-067869ba-7df2-44cf-8eac-143b4dd2e42c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472" status: 200 len: 194 microversion: 2.1 time: 0.113952 May 10 17:32:34.159386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 686/1386] 10.222.0.32 () {58 vars in 1413 bytes} [Mon May 10 17:32:34 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:34.869964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Action: 'create', calling method: .version_select at 0x7f4145238f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-369649526"}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:34.898809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for project 8fb2aa314410446981bed63afd665410. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:32:34.903027 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for user 8bbb55303b15423db320a9b253903c62 and project 8fb2aa314410446981bed63afd665410. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:32:35.141912 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for project 8fb2aa314410446981bed63afd665410. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:32:35.145953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for user 8bbb55303b15423db320a9b253903c62 and project 8fb2aa314410446981bed63afd665410. Resources: {'key_pairs'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:32:35.159839 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-850cd23c-8d81-4c78-947a-b55a9bc5e4f9 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.517685 May 10 17:32:35.160449 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 701/1387] 10.222.0.32 () {60 vars in 1158 bytes} [Mon May 10 17:32:34 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:32:35.806862 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbb63cec-ffa1-4075-8a1c-21fc67313b84"}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:35.808245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:35.816132 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:35.816585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:35.817373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:35.817815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:36.266180 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-63d89221-fd93-4b84-9bd3-bdabdc132a7e tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.462898 May 10 17:32:36.267726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 687/1388] 10.222.0.32 () {60 vars in 1323 bytes} [Mon May 10 17:32:35 2021] POST /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:44.183366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:44.184273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:44.192040 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.192526 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.193302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.193745 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.258773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3e6559d8-c00b-4eb6-80e0-92b47eb79443 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079113 May 10 17:32:44.259307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 702/1389] 10.222.0.32 () {58 vars in 1302 bytes} [Mon May 10 17:32:44 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments => generated 371 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:44.514689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:44.515281 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:44.523318 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.523770 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.525030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.525468 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.588310 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-dc354dab-0529-4ff9-be83-99fd0a3e63ef tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472" status: 200 len: 194 microversion: 2.1 time: 0.078338 May 10 17:32:44.588895 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 688/1390] 10.222.0.32 () {58 vars in 1413 bytes} [Mon May 10 17:32:44 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472 => generated 194 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:44.598321 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:44.598917 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:44.607059 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.607529 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.608352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:44.608808 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:44.769436 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lazy-loading 'services' on Instance uuid 44142629-166e-485c-a8a1-e5e8a09c57d2 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:32:44.904332 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3ae7f22b-f995-4b9f-aaee-3cfe49442fe3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472" status: 202 len: 0 microversion: 2.1 time: 0.309657 May 10 17:32:44.904915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 703/1391] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:32:44 2021] DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/aa7c7a8c-324d-4a96-8ec5-d592c9300472 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:32:47.192985 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:47.193513 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:47.201370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:47.201793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:47.202636 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:47.203092 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:47.269548 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9d6cf72b-32af-4b6c-a6e0-0a4735b950c8 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/fbb63cec-ffa1-4075-8a1c-21fc67313b84" status: 200 len: 194 microversion: 2.1 time: 0.080295 May 10 17:32:47.270175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 689/1392] 10.222.0.32 () {58 vars in 1413 bytes} [Mon May 10 17:32:47 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/fbb63cec-ffa1-4075-8a1c-21fc67313b84 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:32:47.280793 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:47.281388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:47.288866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:47.289330 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:47.290688 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:47.291137 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:47.455861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lazy-loading 'services' on Instance uuid 44142629-166e-485c-a8a1-e5e8a09c57d2 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:32:47.589964 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-94630367-69df-4e12-a97b-2ac3a05833d6 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/fbb63cec-ffa1-4075-8a1c-21fc67313b84" status: 202 len: 0 microversion: 2.1 time: 0.313102 May 10 17:32:47.591071 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 704/1393] 10.222.0.32 () {58 vars in 1416 bytes} [Mon May 10 17:32:47 2021] DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2/os-volume_attachments/fbb63cec-ffa1-4075-8a1c-21fc67313b84 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:32:49.142733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:49.143267 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:49.150804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:49.151251 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:49.152038 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:49.152478 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:49.213460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:32:49.321774 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ea75b81b-8701-484a-93c8-991e90eb4ce1 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 204 len: 0 microversion: 2.1 time: 0.182626 May 10 17:32:49.322452 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 690/1394] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:32:49 2021] DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:32:49.331926 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:49.332573 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:49.340087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:49.340548 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:49.341337 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:49.341782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:49.542564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:32:49.550738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7712df2a-b5e8-42e4-bf18-0402d6876a1c tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1673 microversion: 2.1 time: 0.223807 May 10 17:32:49.551307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 705/1395] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:49 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:32:50.567582 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:50.568220 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:50.576012 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:50.576471 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:50.577265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:50.577704 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:50.778395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:32:50.787166 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9b40afe1-ef02-44a6-b869-ad0ad27a3cb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1673 microversion: 2.1 time: 0.223810 May 10 17:32:50.787751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 691/1396] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:50 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1673 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:32:51.805701 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:51.806364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:51.813619 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:51.814070 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:51.814878 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:51.815324 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:52.268158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:32:52.277159 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-eb83e1c5-524e-4653-8f8f-f45205b40f95 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1673 microversion: 2.1 time: 0.474604 May 10 17:32:52.277744 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 706/1397] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:51 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1673 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:32:53.025877 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-35c568b8-177c-403f-a6cf-a9974d358926 req-44bf4952-ad41-44fd-8799-917816c1f6fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44142629-166e-485c-a8a1-e5e8a09c57d2", "name": "network-vif-deleted", "tag": "0ffa314b-06b8-4f2e-805a-998275908105"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:32:53.028059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:32:53.028059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:32:53.038688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-35c568b8-177c-403f-a6cf-a9974d358926 req-44bf4952-ad41-44fd-8799-917816c1f6fa service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:53.039349 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-35c568b8-177c-403f-a6cf-a9974d358926 req-44bf4952-ad41-44fd-8799-917816c1f6fa service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:53.060687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-35c568b8-177c-403f-a6cf-a9974d358926 req-44bf4952-ad41-44fd-8799-917816c1f6fa service nova] Creating event network-vif-deleted:0ffa314b-06b8-4f2e-805a-998275908105 for instance 44142629-166e-485c-a8a1-e5e8a09c57d2 on hv-cinder-78638 May 10 17:32:53.065443 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-35c568b8-177c-403f-a6cf-a9974d358926 req-44bf4952-ad41-44fd-8799-917816c1f6fa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043182 May 10 17:32:53.066051 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 692/1398] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:32:53.294515 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:53.295140 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:53.302365 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:53.302830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:53.303613 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:53.304068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:53.372564 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:53.373030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:53.373494 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lazy-loading 'fault' on Instance uuid 44142629-166e-485c-a8a1-e5e8a09c57d2 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:32:53.445462 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8e2337f4dc6419899c7ae68538069ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca5e614d86048998dd46f3226b6b322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:32:53.453895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8993a668-80ea-47ff-bf19-b8ffec89c6db tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 200 len: 1326 microversion: 2.1 time: 0.163879 May 10 17:32:53.463454 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 707/1399] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:53 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 1326 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:32:54.473030 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:54.474693 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:54.483239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:54.483835 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:54.484672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:54.485185 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:54.533553 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. May 10 17:32:54.534162 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:32:54.535034 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f4bca999-2fc3-47ef-8338-310bd6a14dcf tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 404 len: 111 microversion: 2.1 time: 0.067928 May 10 17:32:54.535595 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 693/1400] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:54 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:32:54.544203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6773d39b-bcb8-4af6-8dda-c7a13f46f1f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '.version_select at 0x7f41446284c0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:54.562555 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6773d39b-bcb8-4af6-8dda-c7a13f46f1f3 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022680551" status: 202 len: 0 microversion: 2.1 time: 0.022440 May 10 17:32:54.563134 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 708/1401] 10.222.0.32 () {58 vars in 1221 bytes} [Mon May 10 17:32:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022680551 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:32:58.015943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:58.016540 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:58.023601 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:58.024060 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:58.024837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:58.025279 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:58.074430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. May 10 17:32:58.075053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:32:58.075896 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8e810d95-a870-44a0-b997-9237814d759d tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 404 len: 111 microversion: 2.1 time: 0.063990 May 10 17:32:58.076445 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 694/1402] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:32:58 2021] DELETE /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:32:58.084812 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:58.085436 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 44142629-166e-485c-a8a1-e5e8a09c57d2] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:58.093143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:58.093611 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:58.094595 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:58.094902 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:58.143850 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. May 10 17:32:58.144459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 44142629-166e-485c-a8a1-e5e8a09c57d2 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:32:58.145293 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e5df5e2c-6270-4873-ac81-9689818c91b0 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2" status: 404 len: 111 microversion: 2.1 time: 0.064741 May 10 17:32:58.145846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 709/1403] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:58 2021] GET /compute/v2.1/servers/44142629-166e-485c-a8a1-e5e8a09c57d2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:32:58.588810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:32:58.589069 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:32:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:32:59.375506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:59.376016 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:59.383187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:59.383647 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:59.384431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:59.384871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:59.433062 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. May 10 17:32:59.433660 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:32:59.434511 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6cce71b3-9fa8-4756-bf3a-364d5bd5c615 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 404 len: 111 microversion: 2.1 time: 0.062724 May 10 17:32:59.435046 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 695/1404] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:32:59 2021] DELETE /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:32:59.442738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:32:59.443366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] [instance: 48120777-14d3-4deb-9f45-1146dc41c5c6] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:32:59.450570 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:59.451034 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:59.451819 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:32:59.452268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:32:59.500703 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] HTTP exception thrown: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. May 10 17:32:59.501304 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] Returning 404 to user: Instance 48120777-14d3-4deb-9f45-1146dc41c5c6 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:32:59.502130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-95c79c59-5e0f-4ff8-893a-7add3e234fb5 tempest-AttachVolumeTestJSON-953232132 tempest-AttachVolumeTestJSON-953232132-project] 10.222.0.32 "GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6" status: 404 len: 111 microversion: 2.1 time: 0.063090 May 10 17:32:59.502695 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 710/1405] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:32:59 2021] GET /compute/v2.1/servers/48120777-14d3-4deb-9f45-1146dc41c5c6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:33:00.389323 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-592216634", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-369649526", "security_groups": [{"name": "tempest-secgroup-smoke-1276330258"}], "block_device_mapping_v2": [{"uuid": "eb6ec568-a4c3-4ef4-a730-16bc2e88effa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9afab9d9-3171-477a-8041-fd8012e27f60"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:33:00.569356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] validate_networks() for [('9afab9d9-3171-477a-8041-fd8012e27f60', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:33:01.112572 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:33:01.113001 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:33:01.113530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:33:01.113946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:33:01.114386 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:33:01.123321 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:01.123758 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:01.124573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:01.125014 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:01.142584 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:33:01.147041 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for user 8bbb55303b15423db320a9b253903c62 and project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:33:01.253792 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:33:01.256101 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb6ec568-a4c3-4ef4-a730-16bc2e88effa',volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:33:01.446302 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-83b8b682-5e98-4d6f-b953-b5b91a7ccdcc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.060637 May 10 17:33:01.447058 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 696/1406] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:33:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:33:01.457361 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f2c4ead3-39c8-463d-9533-62fb0164a490 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:01.457998 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f2c4ead3-39c8-463d-9533-62fb0164a490 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:01.552317 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f2c4ead3-39c8-463d-9533-62fb0164a490 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:01.560874 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f2c4ead3-39c8-463d-9533-62fb0164a490 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1093 microversion: 2.1 time: 0.107093 May 10 17:33:01.561565 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 711/1407] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:01 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:02.577090 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:02.578454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:02.586978 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:02.587720 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:02.589266 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:02.589868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:02.747072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:02.761625 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f0c40fba-270d-43fb-8810-3585f68b03fa tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1199 microversion: 2.1 time: 0.188237 May 10 17:33:02.772956 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 697/1408] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:02 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1199 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:03.779947 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:03.781414 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:03.795356 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:03.796074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:03.797678 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:03.798580 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:04.270662 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:04.283872 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-590ca836-e065-4d09-a50f-cdd37806dfa6 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.508578 May 10 17:33:04.285167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 712/1409] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:03 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:04.966490 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-2d8932f3-45dd-47da-8c27-5a31a76bc838 req-0cd21cd5-f186-40ec-9e5e-c592574d56be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff8f73d-041a-4dbc-94c3-0e89c67e79d8", "tag": "ca99baec-9ed0-40a9-aa81-311560044e15"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:33:04.968073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:33:04.968073 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:33:04.980201 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2d8932f3-45dd-47da-8c27-5a31a76bc838 req-0cd21cd5-f186-40ec-9e5e-c592574d56be service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:04.980922 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-2d8932f3-45dd-47da-8c27-5a31a76bc838 req-0cd21cd5-f186-40ec-9e5e-c592574d56be service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:05.008264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-2d8932f3-45dd-47da-8c27-5a31a76bc838 req-0cd21cd5-f186-40ec-9e5e-c592574d56be service nova] Creating event network-changed:ca99baec-9ed0-40a9-aa81-311560044e15 for instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 on hv-cinder-78638 May 10 17:33:05.014378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-2d8932f3-45dd-47da-8c27-5a31a76bc838 req-0cd21cd5-f186-40ec-9e5e-c592574d56be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051587 May 10 17:33:05.014999 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 698/1410] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:33:05.301558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:05.302190 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:05.310800 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:05.311263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:05.312058 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:05.312498 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:05.902636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:05.911608 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ec394c9e-4ab1-41aa-bea1-d78f71cb89ad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.614387 May 10 17:33:05.912421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 713/1411] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:05 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:06.929448 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:06.930175 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:06.938123 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:06.938617 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:06.939405 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:06.939906 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:07.142128 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:07.150570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9e12bbe7-cdbb-4224-8659-6742f32269a3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.225570 May 10 17:33:07.151337 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 699/1412] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:06 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:08.167097 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:08.167721 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:08.174978 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:08.175434 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:08.176210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:08.176655 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:08.368203 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:08.376786 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-73039b80-601f-469b-aa6c-0ce13dd5326b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.213396 May 10 17:33:08.377352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 714/1413] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:08 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:09.392826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:09.393444 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:09.400609 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:09.401687 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:09.402482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:09.402921 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:09.598975 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:09.607517 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-cd5e6425-d5f5-44fa-ad0c-536f6e945234 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.218478 May 10 17:33:09.608081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 700/1414] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:09 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:10.624668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:10.625297 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:10.632579 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:10.633044 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:10.633847 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:10.634298 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:10.902048 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:10.911179 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bcd04f63-9762-4fe6-974d-572eb7edd8f7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.290262 May 10 17:33:10.911762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 715/1415] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:10 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:33:11.311833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:33:11.312319 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:33:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:33:11.927918 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:11.928570 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:11.936105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:11.936663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:11.937683 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:11.938115 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:12.243819 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:12.255573 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6697e939-c4ef-4f5f-83f3-5dedc68e4d9a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.331267 May 10 17:33:12.256163 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 701/1416] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:11 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:13.272001 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:13.272562 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:13.280603 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:13.281060 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:13.281846 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:13.282300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:13.486268 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:13.495718 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6162bc63-5fec-4471-a48a-12b3a697ab8d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.227366 May 10 17:33:13.496634 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 716/1417] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:13 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:14.512755 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:14.513479 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:14.520639 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:14.521094 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:14.521871 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:14.522357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:14.721691 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:14.730081 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a04cca35-cf99-47bf-874f-357049426957 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.221591 May 10 17:33:14.730695 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 702/1418] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:14 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:15.746102 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:15.746756 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:15.754278 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:15.754773 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:15.755562 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:15.756010 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:15.946787 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:15.954915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e24c40c4-e064-4451-bbe3-b76b766b6d9f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.212579 May 10 17:33:15.955478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 717/1419] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:15 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:16.972225 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:16.973506 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:16.981395 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:16.981832 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:16.983073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:16.983684 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:17.117557 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-fccd4b2b-4dca-4b2f-a1f6-623a1461a1f8 req-4ff2c16f-7392-4074-b9f4-f59b78302ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff8f73d-041a-4dbc-94c3-0e89c67e79d8", "name": "network-vif-plugged", "status": "completed", "tag": "ca99baec-9ed0-40a9-aa81-311560044e15"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:33:17.119106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:33:17.119106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:33:17.127357 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fccd4b2b-4dca-4b2f-a1f6-623a1461a1f8 req-4ff2c16f-7392-4074-b9f4-f59b78302ad2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:17.127811 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-fccd4b2b-4dca-4b2f-a1f6-623a1461a1f8 req-4ff2c16f-7392-4074-b9f4-f59b78302ad2 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:17.144105 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-fccd4b2b-4dca-4b2f-a1f6-623a1461a1f8 req-4ff2c16f-7392-4074-b9f4-f59b78302ad2 service nova] Creating event network-vif-plugged:ca99baec-9ed0-40a9-aa81-311560044e15 for instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 on hv-cinder-78638 May 10 17:33:17.148826 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-fccd4b2b-4dca-4b2f-a1f6-623a1461a1f8 req-4ff2c16f-7392-4074-b9f4-f59b78302ad2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197587 May 10 17:33:17.149431 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 703/1420] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:33:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:33:17.195357 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:17.204115 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8c90d322-7817-4d3e-8728-9ba4c293ca95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.235687 May 10 17:33:17.204691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 718/1421] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:16 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:18.221954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:18.222692 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:18.230950 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:18.231402 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:18.232171 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:18.232608 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:18.428751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:18.436912 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b16808f2-b1be-44da-b2ee-7d2d1e538c2d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.219127 May 10 17:33:18.437470 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 704/1422] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:18 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:19.454194 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:19.454895 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:19.462050 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:19.462628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:19.463919 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:19.464364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:19.661740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:19.670514 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-78ff44c0-8320-48b1-baa1-617ef5f43f74 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.220060 May 10 17:33:19.671074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 719/1423] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:19 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:20.686786 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:20.687407 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:20.694616 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:20.695072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:20.695843 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:20.696370 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:20.896138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:20.905104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8a79454f-1928-412e-a8e0-9ae4eeaa8436 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.221990 May 10 17:33:20.905668 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 705/1424] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:20 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:33:21.921775 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:21.922459 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:21.930158 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:21.930685 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:21.931468 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:21.931914 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:22.124196 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:22.132352 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6f1a654c-837e-4343-af0c-4f69777d7906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.214250 May 10 17:33:22.132925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 720/1425] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:21 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:23.148822 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:23.149442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:23.157352 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:23.157804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:23.158600 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:23.159042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:23.353214 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:23.361547 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d2dbfa1b-0f83-4381-b32b-cb70d220ef1d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1265 microversion: 2.1 time: 0.216431 May 10 17:33:23.362112 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 706/1426] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:23 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:24.378504 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:24.379127 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:24.386879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:24.387333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:24.388111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:24.388553 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:24.583201 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:24.592273 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-938206bd-ad88-4640-8128-7753260ea97a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1451 microversion: 2.1 time: 0.217471 May 10 17:33:24.592853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 721/1427] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:24 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:24.608135 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:33:24.608751 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:33:24.616067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:24.616518 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:24.617289 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:24.617726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:24.814804 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:33:24.824524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ab7cae86-f5aa-4b95-a443-699c45bdddfb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1451 microversion: 2.1 time: 0.220069 May 10 17:33:24.825084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 707/1428] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:33:24 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:33:27.424074 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-b16bf5d6-f2f1-4637-b84f-a33f987ed644 req-cfa7a89a-861e-4b35-9ff6-e75da47176b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff8f73d-041a-4dbc-94c3-0e89c67e79d8", "tag": "ca99baec-9ed0-40a9-aa81-311560044e15"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:33:27.425647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:33:27.425647 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:33:27.434083 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b16bf5d6-f2f1-4637-b84f-a33f987ed644 req-cfa7a89a-861e-4b35-9ff6-e75da47176b8 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:33:27.434584 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b16bf5d6-f2f1-4637-b84f-a33f987ed644 req-cfa7a89a-861e-4b35-9ff6-e75da47176b8 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:33:27.451051 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-b16bf5d6-f2f1-4637-b84f-a33f987ed644 req-cfa7a89a-861e-4b35-9ff6-e75da47176b8 service nova] Creating event network-changed:ca99baec-9ed0-40a9-aa81-311560044e15 for instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 on hv-cinder-78638 May 10 17:33:27.455961 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-b16bf5d6-f2f1-4637-b84f-a33f987ed644 req-cfa7a89a-861e-4b35-9ff6-e75da47176b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035675 May 10 17:33:27.456551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 722/1429] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:33:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:35:26.290386 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:35:26.290999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:35:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:36:04.128193 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:04.128755 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:04.132208 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [115e479c-151a-42f9-9790-bfe4ceb6bb4a] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 17:36:04.137202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:04.137655 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:04.138487 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:04.138928 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:04.198506 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:36:04.306767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-310ae530-f02c-4233-bcf5-5982654591c2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 204 len: 0 microversion: 2.1 time: 0.182538 May 10 17:36:04.307460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 708/1430] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:36:04 2021] DELETE /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:36:04.314066 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [669db2fe-d426-4823-ba5d-46e61acce9d8] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 17:36:04.317834 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:04.318568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:04.326443 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:04.326923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:04.327710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:04.328155 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:04.668609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:04.677456 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-aba29ca2-621f-4b32-8fea-b145dbd72b95 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1576 microversion: 2.1 time: 0.365484 May 10 17:36:04.678017 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 723/1431] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:04 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1576 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:36:05.695075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:05.695789 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:05.715052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:05.715578 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:05.716409 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:05.716852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:05.768813 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] [115e479c-151a-42f9-9790-bfe4ceb6bb4a] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 49306. May 10 17:36:05.959726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:05.967881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8a46bfc8-ff64-42f3-a40f-41571f7b221f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1576 microversion: 2.1 time: 0.276985 May 10 17:36:05.968501 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 709/1432] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:05 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:06.984784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:06.985444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:07.004354 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:07.004816 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:07.005614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:07.006061 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:07.064622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] [669db2fe-d426-4823-ba5d-46e61acce9d8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 49312. May 10 17:36:07.208417 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:07.216802 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4b0a726b-c1c0-4eb4-b34f-e9a49a8f339d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1508 microversion: 2.1 time: 0.235976 May 10 17:36:07.217378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 724/1433] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:06 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:07.595252 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-ca89a6c3-c350-4e65-bd06-25f356412352 req-e8e520f7-4095-47a6-86b8-322e1d3b9a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff8f73d-041a-4dbc-94c3-0e89c67e79d8", "name": "network-vif-deleted", "tag": "ca99baec-9ed0-40a9-aa81-311560044e15"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:36:07.597210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:36:07.597210 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:36:07.605798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ca89a6c3-c350-4e65-bd06-25f356412352 req-e8e520f7-4095-47a6-86b8-322e1d3b9a4f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:07.606249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-ca89a6c3-c350-4e65-bd06-25f356412352 req-e8e520f7-4095-47a6-86b8-322e1d3b9a4f service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:07.625710 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-ca89a6c3-c350-4e65-bd06-25f356412352 req-e8e520f7-4095-47a6-86b8-322e1d3b9a4f service nova] Creating event network-vif-deleted:ca99baec-9ed0-40a9-aa81-311560044e15 for instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 on hv-cinder-78638 May 10 17:36:07.630072 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-ca89a6c3-c350-4e65-bd06-25f356412352 req-e8e520f7-4095-47a6-86b8-322e1d3b9a4f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100209 May 10 17:36:07.630776 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 710/1434] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:36:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:36:08.234765 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:08.235290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:08.242661 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:08.243118 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:08.243901 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:08.244340 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:08.310676 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:08.311133 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:08.311587 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.objects.instance [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lazy-loading 'fault' on Instance uuid aff8f73d-041a-4dbc-94c3-0e89c67e79d8 {{(pid=92810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 10 17:36:08.390782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:08.399660 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2153b721-8e38-430a-8815-14ed19dc90e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 200 len: 1229 microversion: 2.1 time: 0.169742 May 10 17:36:08.400242 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 725/1435] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:08 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 1229 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:09.417369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:09.418084 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:09.426236 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:09.426721 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:09.427502 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:09.427946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:09.475989 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] HTTP exception thrown: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. May 10 17:36:09.476588 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Returning 404 to user: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:36:09.477411 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-9445afe4-297a-452c-8fe5-45869056d930 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 404 len: 111 microversion: 2.1 time: 0.064276 May 10 17:36:09.477938 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 711/1436] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:09 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:36:09.587578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1064740858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-369649526", "security_groups": [{"name": "tempest-secgroup-smoke-1276330258"}], "block_device_mapping_v2": [{"uuid": "eb6ec568-a4c3-4ef4-a730-16bc2e88effa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9afab9d9-3171-477a-8041-fd8012e27f60"}]}} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:36:09.743139 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.network.neutron [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] validate_networks() for [('9afab9d9-3171-477a-8041-fd8012e27f60', None, None, None)] {{(pid=92810) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:36:10.312995 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:36:10.313438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image limits 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:36:10.313931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:36:10.314379 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image pref 0:0:0 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:36:10.314811 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.virt.hardware [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:36:10.323461 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:10.323925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:10.324770 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:10.325249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:10.343301 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:36:10.347376 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.quota [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for user 8bbb55303b15423db320a9b253903c62 and project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92810) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:36:10.444448 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Going to run 1 instances... {{(pid=92810) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:36:10.446630 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb6ec568-a4c3-4ef4-a730-16bc2e88effa',volume_size=None,volume_type=None)] {{(pid=92810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:36:10.606861 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [33491864-f37d-4c75-bb78-eb5ce7e60c29] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 17:36:11.624866 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [33491864-f37d-4c75-bb78-eb5ce7e60c29] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 49336. May 10 17:36:11.629712 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-dc2100a1-9951-45b3-8470-dead5c97ca6c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.045995 May 10 17:36:11.630381 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 726/1437] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:36:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 2047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:36:11.640505 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-612461b9-5f73-46a8-ba36-a934f0612fd8 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:11.641133 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-612461b9-5f73-46a8-ba36-a934f0612fd8 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:11.808050 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-612461b9-5f73-46a8-ba36-a934f0612fd8 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:11.815850 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-612461b9-5f73-46a8-ba36-a934f0612fd8 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1094 microversion: 2.1 time: 0.179606 May 10 17:36:11.816400 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 712/1438] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:11 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1094 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:12.833639 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-51ceeaab-af6b-4f94-af09-d053e7d21610 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:12.834259 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-51ceeaab-af6b-4f94-af09-d053e7d21610 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:12.903037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-51ceeaab-af6b-4f94-af09-d053e7d21610 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:12.910887 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-51ceeaab-af6b-4f94-af09-d053e7d21610 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1094 microversion: 2.1 time: 0.080876 May 10 17:36:12.911389 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 727/1439] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:12 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:13.926893 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-31f5fbdb-8443-4f93-a854-2769f4aafbc0 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:13.927522 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-31f5fbdb-8443-4f93-a854-2769f4aafbc0 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:14.000265 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-31f5fbdb-8443-4f93-a854-2769f4aafbc0 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:14.009591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-31f5fbdb-8443-4f93-a854-2769f4aafbc0 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1094 microversion: 2.1 time: 0.086214 May 10 17:36:14.010301 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 713/1440] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:13 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:15.026271 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-ea5bcec1-8da6-470f-9bae-fee59432787b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:15.027037 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-ea5bcec1-8da6-470f-9bae-fee59432787b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:15.097501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-ea5bcec1-8da6-470f-9bae-fee59432787b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:15.105438 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-ea5bcec1-8da6-470f-9bae-fee59432787b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1094 microversion: 2.1 time: 0.082535 May 10 17:36:15.105973 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 728/1441] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:15 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:16.122019 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:16.122664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:16.130599 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:16.131053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:16.131825 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:16.132261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:16.243919 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:16.252937 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ee29e8bc-d84d-483a-b9fa-e44a1d512549 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1144 microversion: 2.1 time: 0.134650 May 10 17:36:16.253726 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 714/1442] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:16 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:17.271424 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:17.272306 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:17.280673 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:17.281130 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:17.281948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:17.282416 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:17.412710 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:17.420863 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-7a0860ba-9507-4aa8-b741-369484534697 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1210 microversion: 2.1 time: 0.154648 May 10 17:36:17.421431 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 729/1443] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:17 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1210 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:18.438103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:18.438778 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:18.446637 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:18.447011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:18.447815 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:18.448261 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:18.906988 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:18.915182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-7dcd2abe-f3bf-41d1-9123-a3a93a8f2c6d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.481483 May 10 17:36:18.915943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 715/1444] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:18 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:19.016892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-b68ec97a-63c7-423b-b644-c919686d3a09 req-fc90f130-7cf3-431b-86eb-40705bee055c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff5aaef-e195-4f74-a17f-b1a766b20ea0", "tag": "6b14f35f-6fb2-43b6-a969-8fd46ca905e8"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:36:19.019145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:36:19.019145 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:36:19.036614 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b68ec97a-63c7-423b-b644-c919686d3a09 req-fc90f130-7cf3-431b-86eb-40705bee055c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:19.037275 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-b68ec97a-63c7-423b-b644-c919686d3a09 req-fc90f130-7cf3-431b-86eb-40705bee055c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:19.069056 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-b68ec97a-63c7-423b-b644-c919686d3a09 req-fc90f130-7cf3-431b-86eb-40705bee055c service nova] Creating event network-changed:6b14f35f-6fb2-43b6-a969-8fd46ca905e8 for instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 on hv-cinder-78638 May 10 17:36:19.074545 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-b68ec97a-63c7-423b-b644-c919686d3a09 req-fc90f130-7cf3-431b-86eb-40705bee055c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067021 May 10 17:36:19.075163 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 730/1445] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:36:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:36:19.932567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:19.933334 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:19.941373 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:19.941827 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:19.942643 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:19.943086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:20.035024 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:36:20.035242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:36:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 (ip 10.222.0.32) !!! May 10 17:36:20.226504 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:20.235184 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a08b3f65-4482-4115-8ced-2ce1a89f1670 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.306354 May 10 17:36:20.235760 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 716/1446] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:19 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:21.252249 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:21.252957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:21.260401 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:21.260858 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:21.261628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:21.262067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:21.451838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:21.460447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-fc4067c6-4e9f-487a-8c2f-7371bad64974 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.212324 May 10 17:36:21.461002 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 731/1447] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:21 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:22.476831 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:22.477460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:22.485793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:22.486249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:22.487053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:22.487496 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:22.681530 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:22.689916 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fd911fe3-532f-4056-af9a-c8339ef823e1 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.216864 May 10 17:36:22.690515 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 717/1448] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:22 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:23.706408 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:23.707067 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:23.714358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:23.714920 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:23.715698 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:23.716143 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:23.910853 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:23.919176 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-e0f9f5bd-b97f-4d66-9fc5-8c15cccef7e4 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.216605 May 10 17:36:23.919740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 732/1449] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:23 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:24.935399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:24.936066 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:24.943821 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:24.944278 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:24.945059 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:24.945498 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:25.137399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:25.145526 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-21929518-1397-4310-a19b-07cf84726c97 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.213892 May 10 17:36:25.146085 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 718/1450] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:24 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:26.162659 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:26.163282 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:26.170540 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:26.170999 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:26.172385 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:26.172827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:26.367892 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:26.376045 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-cdc16809-8b3d-481d-827e-39b38220f53d tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.217155 May 10 17:36:26.376607 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 733/1451] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:26 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:27.391868 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:27.392509 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:27.399786 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:27.400238 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:27.401102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:27.401544 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:27.593659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:27.602271 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6f9b71db-9df7-4698-bc0d-432deedf4d50 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.214141 May 10 17:36:27.602954 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 719/1452] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:27 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:28.619738 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:28.620355 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:28.628209 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:28.628663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:28.629436 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:28.629879 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:28.825263 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:28.833387 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9df10e2e-5854-46f2-baf3-55627e606edc tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.217373 May 10 17:36:28.833957 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 734/1453] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:28 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:29.850481 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:29.851088 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:29.858626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:29.859082 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:29.859863 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:29.860303 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:30.054671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:30.063520 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fe3baf1d-0df7-4bf7-b89c-d3583a6a8dc5 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.216318 May 10 17:36:30.064091 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 720/1454] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:29 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:31.079968 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:31.080636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:31.088161 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:31.088628 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:31.089419 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:31.089871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:31.279959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:31.288704 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-40535684-b838-4929-961f-f5dfe51b9dad tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.212525 May 10 17:36:31.289358 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 735/1455] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:31 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:31.329698 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:36:31.330178 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:36:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:36:32.287793 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-3fdb6375-06e0-486e-956b-3503903ad3d9 req-93578d27-ecb7-4972-b667-3c290fa05fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff5aaef-e195-4f74-a17f-b1a766b20ea0", "name": "network-vif-plugged", "status": "completed", "tag": "6b14f35f-6fb2-43b6-a969-8fd46ca905e8"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:36:32.289418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:36:32.289418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:36:32.297890 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-3fdb6375-06e0-486e-956b-3503903ad3d9 req-93578d27-ecb7-4972-b667-3c290fa05fa9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:32.298284 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-3fdb6375-06e0-486e-956b-3503903ad3d9 req-93578d27-ecb7-4972-b667-3c290fa05fa9 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:32.305309 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:32.305935 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:32.313959 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:32.314581 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:32.315378 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:32.315996 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:32.324585 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-3fdb6375-06e0-486e-956b-3503903ad3d9 req-93578d27-ecb7-4972-b667-3c290fa05fa9 service nova] Creating event network-vif-plugged:6b14f35f-6fb2-43b6-a969-8fd46ca905e8 for instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 on hv-cinder-78638 May 10 17:36:32.330418 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-3fdb6375-06e0-486e-956b-3503903ad3d9 req-93578d27-ecb7-4972-b667-3c290fa05fa9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046198 May 10 17:36:32.331314 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 721/1456] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:36:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:36:32.520167 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:32.528838 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-400b4c29-4bb0-4d88-8547-6838b6bfef17 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.227144 May 10 17:36:32.529406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 736/1457] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:32 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:36:33.546467 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:33.547181 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:33.555378 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:33.555837 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:33.556624 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:33.557070 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:33.750211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:33.758430 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f0e368a0-86e7-414f-be2a-1e35461d661e tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1266 microversion: 2.1 time: 0.216204 May 10 17:36:33.758994 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 722/1458] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:33 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:34.774915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:34.775537 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:34.783470 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:34.783925 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:34.784707 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:34.785146 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:34.978284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:34.986908 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f279ed0c-b99c-4b88-96da-8b243237cf5b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1453 microversion: 2.1 time: 0.215832 May 10 17:36:34.987478 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 737/1459] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:34 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:35.002612 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:35.003359 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:36:35.010625 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:35.011079 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:35.011848 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:35.012288 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:35.206602 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:36:35.214681 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-f859eada-41b2-41b8-b0c1-de24109a765c tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1453 microversion: 2.1 time: 0.215790 May 10 17:36:35.215243 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 723/1460] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:36:34 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:36:37.602373 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-638e1621-5544-4847-bf8b-c32949ca9696 req-f5c11731-0828-4466-98d2-b21c2d906442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff5aaef-e195-4f74-a17f-b1a766b20ea0", "tag": "6b14f35f-6fb2-43b6-a969-8fd46ca905e8"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:36:37.604174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:36:37.604174 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:36:37.613723 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-638e1621-5544-4847-bf8b-c32949ca9696 req-f5c11731-0828-4466-98d2-b21c2d906442 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:36:37.614184 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-638e1621-5544-4847-bf8b-c32949ca9696 req-f5c11731-0828-4466-98d2-b21c2d906442 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:36:37.630761 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-638e1621-5544-4847-bf8b-c32949ca9696 req-f5c11731-0828-4466-98d2-b21c2d906442 service nova] Creating event network-changed:6b14f35f-6fb2-43b6-a969-8fd46ca905e8 for instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 on hv-cinder-78638 May 10 17:36:37.636444 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-638e1621-5544-4847-bf8b-c32949ca9696 req-f5c11731-0828-4466-98d2-b21c2d906442 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037479 May 10 17:36:37.637472 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 738/1461] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:36:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:38:37.565098 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1318593360", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-369649526", "security_groups": [{"name": "tempest-secgroup-smoke-1276330258"}], "block_device_mapping_v2": [{"uuid": "fad884f4-4566-4cc2-b6eb-3e2f0b2e1565", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9afab9d9-3171-477a-8041-fd8012e27f60"}]}} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:38:37.721176 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.network.neutron [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] validate_networks() for [('9afab9d9-3171-477a-8041-fd8012e27f60', None, None, None)] {{(pid=92809) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 10 17:38:38.388365 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 10 17:38:38.388799 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image limits 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 10 17:38:38.389315 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Flavor pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 10 17:38:38.389754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Image pref 0:0:0 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 10 17:38:38.390199 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.virt.hardware [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=92809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 10 17:38:38.398590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:38.399043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:38.399856 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:38.400322 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:38.417495 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 10 17:38:38.421455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.quota [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Getting quotas for user 8bbb55303b15423db320a9b253903c62 and project 8fb2aa314410446981bed63afd665410. Resources: {'instances', 'cores', 'ram'} {{(pid=92809) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 10 17:38:38.518869 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Going to run 1 instances... {{(pid=92809) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 10 17:38:38.520990 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fad884f4-4566-4cc2-b6eb-3e2f0b2e1565',volume_size=None,volume_type=None)] {{(pid=92809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 10 17:38:38.683454 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-b2a01e3f-61d0-4504-bda8-5546df15355f tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.122172 May 10 17:38:38.684413 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 724/1462] 10.222.0.32 () {60 vars in 1147 bytes} [Mon May 10 17:38:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:38:38.695193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9f12506f-cf8c-4a26-b0d9-60316a196a75 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:38.695934 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9f12506f-cf8c-4a26-b0d9-60316a196a75 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:38.767948 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9f12506f-cf8c-4a26-b0d9-60316a196a75 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:38.776856 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9f12506f-cf8c-4a26-b0d9-60316a196a75 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1094 microversion: 2.1 time: 0.086015 May 10 17:38:38.777421 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 739/1463] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:38 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:38:39.793366 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:39.793998 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:39.803455 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:39.803920 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:39.804733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:39.805187 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:39.936036 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:39.944239 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2991f2d1-91a4-40f1-8047-de0f4bbbd906 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1210 microversion: 2.1 time: 0.155078 May 10 17:38:39.944806 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 725/1464] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:39 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:40.960913 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:40.961543 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:40.969290 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:40.969880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:40.970801 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:40.971312 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:41.397057 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:41.405950 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-6766ab7d-8533-4ff0-8134-9e8e485c188b tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.448752 May 10 17:38:41.406559 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 740/1465] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:40 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:41.829375 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-dea8f76a-2dce-45ab-9a97-9a57a7190e72 req-6066ca25-c772-4055-9a21-d4d95e6a5682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e069a3f5-c872-4407-b832-cf466a2e410d", "tag": "d412858b-77b3-43ad-95a2-1fae647a84e9"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:38:41.831028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:38:41.831028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:38:41.839898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-dea8f76a-2dce-45ab-9a97-9a57a7190e72 req-6066ca25-c772-4055-9a21-d4d95e6a5682 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:41.840423 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-dea8f76a-2dce-45ab-9a97-9a57a7190e72 req-6066ca25-c772-4055-9a21-d4d95e6a5682 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:41.867653 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-dea8f76a-2dce-45ab-9a97-9a57a7190e72 req-6066ca25-c772-4055-9a21-d4d95e6a5682 service nova] Creating event network-changed:d412858b-77b3-43ad-95a2-1fae647a84e9 for instance e069a3f5-c872-4407-b832-cf466a2e410d on hv-cinder-78638 May 10 17:38:41.873936 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-dea8f76a-2dce-45ab-9a97-9a57a7190e72 req-6066ca25-c772-4055-9a21-d4d95e6a5682 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048058 May 10 17:38:41.874535 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 726/1466] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:38:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:38:42.422262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:42.423030 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:42.430576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:42.431041 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:42.431865 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:42.432318 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:42.880068 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:42.888558 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-2a9feb44-2fed-448d-889d-6fe5fe2cf2ec tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.470055 May 10 17:38:42.889065 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 741/1467] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:42 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:43.905512 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:43.906217 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:43.913622 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:43.914076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:43.914881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:43.915316 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:44.110043 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:44.118147 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e2965df1-6455-49d5-94ee-4a6392055c15 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.216796 May 10 17:38:44.118750 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 727/1468] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:43 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:45.134753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:45.135415 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:45.143300 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:45.143768 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:45.144562 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:45.145018 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:45.338398 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:45.346696 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-bb95532d-20b6-4601-b01a-1fe35a94f1ba tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.215695 May 10 17:38:45.347266 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 742/1469] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:45 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:46.308663 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:38:46.309193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:38:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:38:46.362977 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:46.363598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:46.370981 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:46.371388 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:46.372172 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:46.372617 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:46.560574 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:46.568684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-ecdfe5dc-1b24-42ed-92d4-69bec19b6a58 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.209403 May 10 17:38:46.569249 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 728/1470] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:46 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:47.585674 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:47.586302 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:47.594292 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:47.594798 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:47.595589 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:47.596036 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:47.788508 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:47.797366 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-9bf752ab-3cd5-4913-8947-9f7c18d92a13 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.215502 May 10 17:38:47.797930 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 743/1471] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:47 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:48.813399 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:48.814022 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:48.821356 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:48.821810 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:48.822632 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:48.823076 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:49.019524 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:49.028269 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-edc932a7-592d-465a-befb-7e204ae6ea56 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.218652 May 10 17:38:49.028833 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 729/1472] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:48 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:50.044652 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:50.045402 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:50.052720 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:50.053177 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:50.053960 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:50.054434 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:50.249810 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:50.258087 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-4e8b12a7-156b-4a8e-bbaa-7a3597005d08 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.217202 May 10 17:38:50.258691 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 744/1473] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:50 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:51.274007 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:51.274663 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:51.282529 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:51.282991 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:51.283767 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:51.284211 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:51.616626 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:51.624768 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-2f59cb89-c595-40c5-ba7f-57996cf5ce7a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.354486 May 10 17:38:51.625332 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 730/1474] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:51 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:52.641732 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:52.642380 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:52.649640 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:52.650106 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:52.650939 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:52.651967 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:52.850447 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:52.858931 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-73948481-1c67-48b7-a1cd-b559cc3b4a11 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.220945 May 10 17:38:52.859501 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 745/1475] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:52 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:53.875404 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:53.876028 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:53.883282 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:53.883740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:53.884523 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:53.884964 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:54.075881 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:54.084074 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-3d447bca-b930-44ba-a416-0d4314e1df05 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.212304 May 10 17:38:54.084627 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 731/1476] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:53 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:54.921923 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-4bdc3d62-c6bd-4fb4-a0f6-15782650e479 req-2ef74149-2bd9-4a35-983a-08a723cc5e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e069a3f5-c872-4407-b832-cf466a2e410d", "name": "network-vif-plugged", "status": "completed", "tag": "d412858b-77b3-43ad-95a2-1fae647a84e9"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:38:54.923827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:38:54.923827 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:38:54.932284 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-4bdc3d62-c6bd-4fb4-a0f6-15782650e479 req-2ef74149-2bd9-4a35-983a-08a723cc5e12 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:54.933509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-4bdc3d62-c6bd-4fb4-a0f6-15782650e479 req-2ef74149-2bd9-4a35-983a-08a723cc5e12 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:54.950223 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-4bdc3d62-c6bd-4fb4-a0f6-15782650e479 req-2ef74149-2bd9-4a35-983a-08a723cc5e12 service nova] Creating event network-vif-plugged:d412858b-77b3-43ad-95a2-1fae647a84e9 for instance e069a3f5-c872-4407-b832-cf466a2e410d on hv-cinder-78638 May 10 17:38:54.955218 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-4bdc3d62-c6bd-4fb4-a0f6-15782650e479 req-2ef74149-2bd9-4a35-983a-08a723cc5e12 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094798 May 10 17:38:54.955880 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 746/1477] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:38:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:38:55.100943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:55.101605 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:55.109718 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:55.110179 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:55.111067 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:55.111563 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:55.394590 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:55.403460 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fdece7af-e545-4de6-a61d-c022fa4fe9fd tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.306302 May 10 17:38:55.404023 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 732/1478] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:55 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:56.421251 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:56.421971 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:56.429592 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:56.430052 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:56.430862 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:56.431310 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:56.620915 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:56.629111 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-8a341acf-b4eb-43d7-aeab-38fec2df56d2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1266 microversion: 2.1 time: 0.212599 May 10 17:38:56.629680 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 747/1479] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:56 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:57.646489 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:57.647109 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:57.654441 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:57.654898 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:57.655671 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:57.656104 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:57.858106 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:57.866264 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-d1f9bbb3-4594-4fce-97aa-7b3e8fdf003a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1452 microversion: 2.1 time: 0.223586 May 10 17:38:57.866852 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 733/1480] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:57 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:38:57.882727 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:57.883360 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:38:57.890641 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:57.891094 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:57.891869 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:38:57.892307 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:38:58.203668 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:38:58.211990 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-87c5ba08-a5f0-42d1-a39b-912fb5ff91a7 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1452 microversion: 2.1 time: 0.333238 May 10 17:38:58.212568 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 748/1481] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:38:57 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1452 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:39:00.785552 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-8e92c249-97b7-42ce-88ab-b92b482484b4 req-12069023-2665-46be-9b8a-bd57e7956986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e069a3f5-c872-4407-b832-cf466a2e410d", "tag": "d412858b-77b3-43ad-95a2-1fae647a84e9"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:39:00.787130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:39:00.787130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:39:00.796280 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8e92c249-97b7-42ce-88ab-b92b482484b4 req-12069023-2665-46be-9b8a-bd57e7956986 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:39:00.796733 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-8e92c249-97b7-42ce-88ab-b92b482484b4 req-12069023-2665-46be-9b8a-bd57e7956986 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:39:00.812849 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-8e92c249-97b7-42ce-88ab-b92b482484b4 req-12069023-2665-46be-9b8a-bd57e7956986 service nova] Creating event network-changed:d412858b-77b3-43ad-95a2-1fae647a84e9 for instance e069a3f5-c872-4407-b832-cf466a2e410d on hv-cinder-78638 May 10 17:39:00.817754 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-8e92c249-97b7-42ce-88ab-b92b482484b4 req-12069023-2665-46be-9b8a-bd57e7956986 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087263 May 10 17:39:00.818438 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 734/1482] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:39:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:39:51.347723 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:39:51.348374 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:39:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:40:51.369069 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [115e479c-151a-42f9-9790-bfe4ceb6bb4a] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 17:40:51.369753 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:51.370256 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:51.373254 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-d0cfe0d4-1972-454d-b00e-822eadf3f91d req-57ca2ec6-7d0b-4dd7-892f-5b4dd2b5188b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e069a3f5-c872-4407-b832-cf466a2e410d", "tag": "d412858b-77b3-43ad-95a2-1fae647a84e9"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:40:51.375048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:51.375048 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:40:51.378028 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:51.378740 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:51.379544 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:51.380000 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:51.384740 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d0cfe0d4-1972-454d-b00e-822eadf3f91d req-57ca2ec6-7d0b-4dd7-892f-5b4dd2b5188b service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:51.385245 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-d0cfe0d4-1972-454d-b00e-822eadf3f91d req-57ca2ec6-7d0b-4dd7-892f-5b4dd2b5188b service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:51.401824 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-d0cfe0d4-1972-454d-b00e-822eadf3f91d req-57ca2ec6-7d0b-4dd7-892f-5b4dd2b5188b service nova] Creating event network-changed:d412858b-77b3-43ad-95a2-1fae647a84e9 for instance e069a3f5-c872-4407-b832-cf466a2e410d on hv-cinder-78638 May 10 17:40:51.407943 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-d0cfe0d4-1972-454d-b00e-822eadf3f91d req-57ca2ec6-7d0b-4dd7-892f-5b4dd2b5188b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040092 May 10 17:40:51.409102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 735/1483] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:40:51.441172 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Going to try to terminate instance {{(pid=92810) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:40:51.560551 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-3fac5b40-3950-4bd7-b1d2-6d6fb6365105 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 204 len: 0 microversion: 2.1 time: 0.193685 May 10 17:40:51.562596 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 749/1484] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:40:51 2021] DELETE /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:40:51.572127 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:51.572853 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:51.581329 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:51.581798 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:51.582652 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:51.583103 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:51.956130 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:40:51.964562 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-6fbb3eac-ed4c-42ca-8dfc-bb1c1cf3c44a tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1576 microversion: 2.1 time: 0.397550 May 10 17:40:51.965221 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 736/1485] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:40:51 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1576 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:40:52.981833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:52.982833 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:52.990210 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:52.990709 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:52.991509 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:52.991953 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:53.185162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:40:53.193928 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-088652a7-d583-4a0e-b05d-fa51eb01c669 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1458 microversion: 2.1 time: 0.216288 May 10 17:40:53.194533 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 750/1486] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:40:52 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1458 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:40:54.214052 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:54.214756 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:54.234974 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:54.235442 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:54.236242 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:54.236684 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:54.253687 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-387bbde7-828a-45b8-9173-2d7c6dbc9106 req-0b541007-1c94-44d1-9a05-ee13792ea11c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e069a3f5-c872-4407-b832-cf466a2e410d", "name": "network-vif-deleted", "tag": "d412858b-77b3-43ad-95a2-1fae647a84e9"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:40:54.255784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:54.255784 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:40:54.264029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-387bbde7-828a-45b8-9173-2d7c6dbc9106 req-0b541007-1c94-44d1-9a05-ee13792ea11c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:54.265207 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-387bbde7-828a-45b8-9173-2d7c6dbc9106 req-0b541007-1c94-44d1-9a05-ee13792ea11c service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:54.285762 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-387bbde7-828a-45b8-9173-2d7c6dbc9106 req-0b541007-1c94-44d1-9a05-ee13792ea11c service nova] Creating event network-vif-deleted:d412858b-77b3-43ad-95a2-1fae647a84e9 for instance e069a3f5-c872-4407-b832-cf466a2e410d on hv-cinder-78638 May 10 17:40:54.291162 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-387bbde7-828a-45b8-9173-2d7c6dbc9106 req-0b541007-1c94-44d1-9a05-ee13792ea11c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040978 May 10 17:40:54.292124 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 751/1487] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:40:54.293436 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] [115e479c-151a-42f9-9790-bfe4ceb6bb4a] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 49610. May 10 17:40:54.371335 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:40:54.379635 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-8e31ad0b-bf9f-4dd1-a7b0-baaf3bae9a38 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 200 len: 1390 microversion: 2.1 time: 0.170997 May 10 17:40:54.380190 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 737/1488] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:40:54 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:40:55.396871 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:55.397636 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: e069a3f5-c872-4407-b832-cf466a2e410d] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:55.405576 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:55.406029 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:55.406830 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:55.407274 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:55.454829 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] HTTP exception thrown: Instance e069a3f5-c872-4407-b832-cf466a2e410d could not be found. May 10 17:40:55.455423 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Returning 404 to user: Instance e069a3f5-c872-4407-b832-cf466a2e410d could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:40:55.456240 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c02c8104-525f-4a5c-b40e-322c131567cb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d" status: 404 len: 111 microversion: 2.1 time: 0.063546 May 10 17:40:55.456767 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 752/1489] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:40:55 2021] GET /compute/v2.1/servers/e069a3f5-c872-4407-b832-cf466a2e410d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:40:59.341281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [req-728f23a5-e3cf-4e70-a19f-1443cf2c90b1 req-bcd8ed2c-971f-483e-9015-02d98198a508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff5aaef-e195-4f74-a17f-b1a766b20ea0", "tag": "6b14f35f-6fb2-43b6-a969-8fd46ca905e8"}]} {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:40:59.345215 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:59.347364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:40:59.347364 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: warnings.warn(msg) May 10 17:40:59.347719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:59.360435 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:59.361203 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:59.361406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-728f23a5-e3cf-4e70-a19f-1443cf2c90b1 req-bcd8ed2c-971f-483e-9015-02d98198a508 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:59.361898 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [req-728f23a5-e3cf-4e70-a19f-1443cf2c90b1 req-bcd8ed2c-971f-483e-9015-02d98198a508 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:59.362689 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:59.363344 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:59.379388 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.compute.server_external_events [req-728f23a5-e3cf-4e70-a19f-1443cf2c90b1 req-bcd8ed2c-971f-483e-9015-02d98198a508 service nova] Creating event network-changed:6b14f35f-6fb2-43b6-a969-8fd46ca905e8 for instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 on hv-cinder-78638 May 10 17:40:59.384474 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [req-728f23a5-e3cf-4e70-a19f-1443cf2c90b1 req-bcd8ed2c-971f-483e-9015-02d98198a508 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046773 May 10 17:40:59.385406 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 753/1490] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:40:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:40:59.425056 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Going to try to terminate instance {{(pid=92809) delete /opt/stack/nova/nova/compute/api.py:2539}} May 10 17:40:59.545942 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-e626e785-d643-484a-aa75-868bb02f0c06 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 204 len: 0 microversion: 2.1 time: 0.209536 May 10 17:40:59.546598 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 738/1491] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:40:59 2021] DELETE /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:40:59.555646 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:40:59.557436 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:40:59.565677 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:59.566809 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:59.567609 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:40:59.568062 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:40:59.893274 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:40:59.902262 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-c92be632-c960-422e-8afa-ab780819e3eb tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1459 microversion: 2.1 time: 0.351207 May 10 17:40:59.912272 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 754/1492] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:40:59 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1459 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:41:00.920260 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:00.920976 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:41:00.928226 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:00.928688 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:00.929472 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:00.929917 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:01.123874 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.policy [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92809) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:41:01.132053 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-c598e2de-5dab-4430-b2e8-68c2f48c2896 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1459 microversion: 2.1 time: 0.215961 May 10 17:41:01.132640 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 739/1493] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:41:00 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1459 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:41:02.149015 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:02.149681 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:41:02.155155 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [req-7287a06a-ab4d-4b65-8631-53250ff3e771 req-cceb3bca-c42b-4868-96dd-bec93cbeab88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff5aaef-e195-4f74-a17f-b1a766b20ea0", "name": "network-vif-deleted", "tag": "6b14f35f-6fb2-43b6-a969-8fd46ca905e8"}]} {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:41:02.157273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:41:02.157273 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: warnings.warn(msg) May 10 17:41:02.157782 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:02.158245 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:02.159073 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:02.159541 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:02.165583 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7287a06a-ab4d-4b65-8631-53250ff3e771 req-cceb3bca-c42b-4868-96dd-bec93cbeab88 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:02.166035 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [req-7287a06a-ab4d-4b65-8631-53250ff3e771 req-cceb3bca-c42b-4868-96dd-bec93cbeab88 service nova] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:02.183102 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.compute.server_external_events [req-7287a06a-ab4d-4b65-8631-53250ff3e771 req-cceb3bca-c42b-4868-96dd-bec93cbeab88 service nova] Creating event network-vif-deleted:6b14f35f-6fb2-43b6-a969-8fd46ca905e8 for instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 on hv-cinder-78638 May 10 17:41:02.187968 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [req-7287a06a-ab4d-4b65-8631-53250ff3e771 req-cceb3bca-c42b-4868-96dd-bec93cbeab88 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036719 May 10 17:41:02.188634 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 740/1494] 10.222.0.32 () {64 vars in 1318 bytes} [Mon May 10 17:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:41:02.293377 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.policy [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bbb55303b15423db320a9b253903c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fb2aa314410446981bed63afd665410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92810) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:41:02.302427 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-d510f512-b6c1-4cc7-b594-57ca2ae09f41 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 200 len: 1225 microversion: 2.1 time: 0.157305 May 10 17:41:02.303032 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 755/1495] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:41:02 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 1225 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:41:03.319664 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:03.320294 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: 2ff5aaef-e195-4f74-a17f-b1a766b20ea0] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:41:03.328256 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:03.328719 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:03.329499 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:03.329946 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:03.377747 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] HTTP exception thrown: Instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 could not be found. May 10 17:41:03.378369 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Returning 404 to user: Instance 2ff5aaef-e195-4f74-a17f-b1a766b20ea0 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:41:03.379202 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-a831c2a6-9ebb-4454-9bdf-4cf935632093 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0" status: 404 len: 111 microversion: 2.1 time: 0.063876 May 10 17:41:03.379729 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 741/1496] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:41:03 2021] GET /compute/v2.1/servers/2ff5aaef-e195-4f74-a17f-b1a766b20ea0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:41:04.098764 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:04.099281 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.compute.api [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92810) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:41:04.106578 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:04.107288 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:04.108077 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:04.108524 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG oslo_concurrency.lockutils [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:04.159314 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.wsgi [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] HTTP exception thrown: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. May 10 17:41:04.159911 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Returning 404 to user: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. {{(pid=92810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:41:04.160937 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-035e673b-67b1-4796-8157-a4f34f22e1f2 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 404 len: 111 microversion: 2.1 time: 0.065834 May 10 17:41:04.161375 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 756/1497] 10.222.0.32 () {58 vars in 1239 bytes} [Mon May 10 17:41:04 2021] DELETE /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:41:04.169453 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '>' {{(pid=92809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:04.170068 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.compute.api [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] [instance: aff8f73d-041a-4dbc-94c3-0e89c67e79d8] Fetching instance by UUID {{(pid=92809) get /opt/stack/nova/nova/compute/api.py:2790}} May 10 17:41:04.177784 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:04.178237 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:04.179042 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 10 17:41:04.179482 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG oslo_concurrency.lockutils [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Lock "6740535e-d17c-4eb6-84e0-32c35a6a2437" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 10 17:41:04.227542 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.wsgi [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] HTTP exception thrown: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. May 10 17:41:04.228075 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: DEBUG nova.api.openstack.wsgi [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Returning 404 to user: Instance aff8f73d-041a-4dbc-94c3-0e89c67e79d8 could not be found. {{(pid=92809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 10 17:41:04.229138 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO nova.api.openstack.requestlog [None req-fb579545-f43f-41ab-a5d2-84109e79f279 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8" status: 404 len: 111 microversion: 2.1 time: 0.063205 May 10 17:41:04.229659 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: [pid: 92809|app: 0|req: 742/1498] 10.222.0.32 () {58 vars in 1236 bytes} [Mon May 10 17:41:04 2021] GET /compute/v2.1/servers/aff8f73d-041a-4dbc-94c3-0e89c67e79d8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:41:05.661011 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: DEBUG nova.api.openstack.wsgi [None req-f03c0aca-4d54-47e2-80dd-51e5a749aec3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] Calling method '.version_select at 0x7f41445b90d0>' {{(pid=92810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:41:05.683451 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO nova.api.openstack.requestlog [None req-f03c0aca-4d54-47e2-80dd-51e5a749aec3 tempest-TestVolumeBootPattern-1068598026 tempest-TestVolumeBootPattern-1068598026-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-369649526" status: 202 len: 0 microversion: 2.1 time: 0.026810 May 10 17:41:05.684022 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: [pid: 92810|app: 0|req: 757/1499] 10.222.0.32 () {58 vars in 1260 bytes} [Mon May 10 17:41:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-369649526 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:41:18.612755 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:41:18.613397 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:41:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:41:20.055011 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:41:20.055567 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:41:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:43:11.366395 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:43:11.367086 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:43:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:43:32.724042 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:43:32.724577 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:43:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:43:33.295146 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:43:33.295669 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:43:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:43:46.328229 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:43:46.328822 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:43:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:44:38.632563 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:44:38.633193 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:44:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:44:40.072182 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:44:40.072672 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:44:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:46:31.384591 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:46:31.385297 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:46:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:46:52.742622 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:46:52.743333 dv-cinder-786383-3-iscsi devstack@n-api.service[92810]: Mon May 10 17:46:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:46:53.312406 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:46:53.312930 dv-cinder-786383-3-iscsi devstack@n-api.service[92809]: Mon May 10 17:46:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!